[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:09 dist-test-slave-8hhm krb5kdc[12179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:09 dist-test-slave-8hhm krb5kdc[12179](info): set up 2 sockets
Aug 11 14:58:09 dist-test-slave-8hhm krb5kdc[12179](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 14:58:10.791685 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:10 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:10.930388 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:37291
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:37291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:11.053057 12199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:11.053350 12199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:11.053397 12199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:11.057613 12199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:11.057672 12199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:11.057693 12199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:11.057709 12199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:11.057725 12199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:11.063145 12199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:37291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:37291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:11.064538 12199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:11.065953 12199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:11.078207 12208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.078224 12211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.078627 12199 server_base.cc:1034] running on GCE node
W20260811 14:58:11.078799 12209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.079493 12199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:11.081157 12199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:11.082373 12199 hybrid_clock.cc:648] HybridClock initialized: now 1786460291082343 us; error 44 us; skew 500 ppm
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:11.085553 12199 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:11.086740 12199 webserver.cc:460] Webserver started at http://127.11.225.126:40815/ using document root <none> and password file <none>
I20260811 14:58:11.087682 12199 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:11.087783 12199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:11.088186 12199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:11.090796 12199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "014772bba6b140e99fb6b916cbdd8bc1"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "f3530e61268f9c7ff0b5d6d565a5c01b"
server_key_iv: "5ce43ff2a7f7730c113a3e65906cbee4"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.091442 12199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "014772bba6b140e99fb6b916cbdd8bc1"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "f3530e61268f9c7ff0b5d6d565a5c01b"
server_key_iv: "5ce43ff2a7f7730c113a3e65906cbee4"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.096707 12199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 14:58:11.100306 12224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.101893 12199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:11.102113 12199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "014772bba6b140e99fb6b916cbdd8bc1"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "f3530e61268f9c7ff0b5d6d565a5c01b"
server_key_iv: "5ce43ff2a7f7730c113a3e65906cbee4"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.102240 12199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:11.130198 12199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:11.134307 12199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:11.134569 12199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:11.144517 12199 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:37291
I20260811 14:58:11.144539 12315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:37291 every 8 connection(s)
I20260811 14:58:11.146278 12199 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:11.148587 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12199
I20260811 14:58:11.148711 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:11.150238 12165 external_mini_cluster.cc:1428] Setting key d979244b0ca5b655da9ffcff4f8fea31
I20260811 14:58:11.152205 12316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:11.161562 12316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1: Bootstrap starting.
I20260811 14:58:11.166487 12316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:11.168665 12316 log.cc:824] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:11.171626 12316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1: No bootstrap required, opened a new log
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:11.178484 12316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } }
I20260811 14:58:11.178836 12316 raft_consensus.cc:374] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:11.178951 12316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014772bba6b140e99fb6b916cbdd8bc1, State: Initialized, Role: FOLLOWER
I20260811 14:58:11.179895 12316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } }
I20260811 14:58:11.180133 12316 raft_consensus.cc:388] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:11.180276 12316 raft_consensus.cc:482] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:11.180419 12316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:11.181922 12316 raft_consensus.cc:504] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } }
I20260811 14:58:11.182638 12316 leader_election.cc:302] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 014772bba6b140e99fb6b916cbdd8bc1; no voters:
I20260811 14:58:11.182893 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.154966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.11.225.126:37291)
0811 14:58:11.155503 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.155528 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.158684 (+ 3156us) server_negotiation.cc:407] Connection header received
0811 14:58:11.162319 (+ 3635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.162367 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.163013 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.163482 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.165845 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.168095 (+ 2250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.169443 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.170062 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.170229 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.174758 (+ 4529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.174812 (+ 54us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.174830 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.174867 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.178273 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.178821 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.178827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.178833 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.179030 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.179463 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.179467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.179469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.180244 (+ 775us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.180485 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.181169 (+ 684us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.181571 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":128,"threads_started":1}
I20260811 14:58:11.183075 12316 leader_election.cc:288] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:11.183284 12322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:11.183506 12322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 014772bba6b140e99fb6b916cbdd8bc1, State: Running, Role: LEADER
I20260811 14:58:11.183971 12322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } }
I20260811 14:58:11.184935 12316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:11.187191 12324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 014772bba6b140e99fb6b916cbdd8bc1. Latest consensus state: current_term: 1 leader_uuid: "014772bba6b140e99fb6b916cbdd8bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } } }
I20260811 14:58:11.187350 12324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:11.188002 12334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:11.188243 12323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "014772bba6b140e99fb6b916cbdd8bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "014772bba6b140e99fb6b916cbdd8bc1" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37291 } } }
I20260811 14:58:11.188350 12323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:11.192426 12334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:11.201764 12334 catalog_manager.cc:1347] Generated new cluster ID: 0e8aa312c0c94feeaa679f3083e1dd72
I20260811 14:58:11.201866 12334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:11.214213 12334 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:11.215160 12334 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:11.220368 12334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 014772bba6b140e99fb6b916cbdd8bc1: Generated new TSK 0
I20260811 14:58:11.221168 12334 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:11.259864 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:11.380827 12349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:11.381078 12349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:11.381124 12349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:11.385632 12349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:11.385722 12349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:11.385805 12349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:11.391721 12349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:11.392755 12349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:11.393810 12349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:11.404546 12361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.404636 12349 server_base.cc:1034] running on GCE node
W20260811 14:58:11.404556 12356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.404556 12355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.405181 12349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:11.406008 12349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:11.407207 12349 hybrid_clock.cc:648] HybridClock initialized: now 1786460291407188 us; error 35 us; skew 500 ppm
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:11.410264 12349 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:11.411180 12349 webserver.cc:460] Webserver started at http://127.11.225.65:41477/ using document root <none> and password file <none>
I20260811 14:58:11.411810 12349 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:11.411914 12349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:11.412168 12349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:11.414453 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "36ed8842cf634d53b30278383c1a74ac"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "c4c92f9753cc1bc7aaf2104d69da7a7a"
server_key_iv: "d7f317d4aa14937b72b27d1e53d73f61"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.415077 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "36ed8842cf634d53b30278383c1a74ac"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "c4c92f9753cc1bc7aaf2104d69da7a7a"
server_key_iv: "d7f317d4aa14937b72b27d1e53d73f61"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.419245 12349 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 14:58:11.421875 12372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.423066 12349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:11.423210 12349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "36ed8842cf634d53b30278383c1a74ac"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "c4c92f9753cc1bc7aaf2104d69da7a7a"
server_key_iv: "d7f317d4aa14937b72b27d1e53d73f61"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.423327 12349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:11.440744 12349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:11.443493 12349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:11.443686 12349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:11.444337 12349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:11.445489 12349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:11.445560 12349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.445628 12349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:11.445676 12349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.455523 12349 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:34681
I20260811 14:58:11.455581 12557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:34681 every 8 connection(s)
I20260811 14:58:11.456444 12349 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:11.457099 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12349
I20260811 14:58:11.457203 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:11.457517 12165 external_mini_cluster.cc:1428] Setting key eee305bd79e631ed80d83a6743f05050
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:11.473328 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.458722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33007 (local address 127.11.225.126:37291)
0811 14:58:11.458870 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.458875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.459907 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 14:58:11.461949 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.461955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.462012 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.462123 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.463242 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.464157 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.465740 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.465974 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.466077 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.469153 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.469158 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.469161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.469193 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.470801 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.471319 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.471322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.471324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.471485 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.471875 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.471881 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.471884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.472110 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.472228 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.472971 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.473135 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 14:58:11.474288 12562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.459207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37291 (local address 127.11.225.65:33007)
0811 14:58:11.459724 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:11.459783 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:11.461734 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:11.462282 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:11.462288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:11.462627 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:11.463091 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.463103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.464300 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.464302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.465588 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.465604 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.466171 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.466178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.466432 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.467128 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:11.467154 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:11.468957 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:11.470925 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.470931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.470946 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.471211 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.471581 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.471584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.471586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.471767 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.472286 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:11.472292 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:11.472595 (+ 303us) client_negotiation.cc:769] Sending connection context
0811 14:58:11.472819 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 14:58:11.473191 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":119,"threads_started":1}
I20260811 14:58:11.475656 12559 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37291
I20260811 14:58:11.475922 12559 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:11.476528 12559 heartbeater.cc:511] Master 127.11.225.126:37291 requested a full tablet report, sending...
I20260811 14:58:11.478734 12247 ts_manager.cc:194] Registered new tserver with Master: 36ed8842cf634d53b30278383c1a74ac (127.11.225.65:34681)
I20260811 14:58:11.480201 12247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:33007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:11.489176 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:11.600160 12565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:11.600440 12565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:11.600533 12565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:11.604614 12565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:11.604699 12565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:11.604787 12565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:11.609714 12565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:11.610674 12565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:11.611727 12565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:58:11.621382 12565 server_base.cc:1034] running on GCE node
W20260811 14:58:11.621372 12575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.621361 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.621560 12572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.621943 12565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:11.622576 12565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:11.623755 12565 hybrid_clock.cc:648] HybridClock initialized: now 1786460291623734 us; error 31 us; skew 500 ppm
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:11.626585 12565 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:11.627415 12565 webserver.cc:460] Webserver started at http://127.11.225.66:42217/ using document root <none> and password file <none>
I20260811 14:58:11.628031 12565 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:11.628094 12565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:11.628252 12565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:11.630244 12565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "dafa596a120f4d0fb5cb62903a5537d9"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "274d6cb483b8f45f776c063c67db55f8"
server_key_iv: "36fe4f3cf793acbee2f49b2b3594ddee"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.630818 12565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "dafa596a120f4d0fb5cb62903a5537d9"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "274d6cb483b8f45f776c063c67db55f8"
server_key_iv: "36fe4f3cf793acbee2f49b2b3594ddee"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.634419 12565 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:11.636725 12584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.638127 12565 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:11.638273 12565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "dafa596a120f4d0fb5cb62903a5537d9"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "274d6cb483b8f45f776c063c67db55f8"
server_key_iv: "36fe4f3cf793acbee2f49b2b3594ddee"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.638393 12565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:11.652709 12565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:11.655900 12565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:11.656126 12565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:11.656726 12565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:11.657791 12565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:11.657842 12565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.657907 12565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:11.657940 12565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.667378 12565 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:37789
I20260811 14:58:11.667402 12776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:37789 every 8 connection(s)
I20260811 14:58:11.668274 12565 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:11.675328 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12565
I20260811 14:58:11.675480 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:11.675782 12165 external_mini_cluster.cc:1428] Setting key 0d67469ea992de755d462c164df17fd2
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:11.682735 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.670251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:34775 (local address 127.11.225.126:37291)
0811 14:58:11.670414 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.670419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.671337 (+ 918us) server_negotiation.cc:407] Connection header received
0811 14:58:11.672620 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.672626 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.672694 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.672770 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.674079 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.674602 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.675917 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.676156 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.676274 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.678974 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.678978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.678981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.679008 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.680425 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.680931 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.680934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.680936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.681017 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.681422 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.681426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.681428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.681606 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.681723 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.682357 (+ 634us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.682501 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:58:11.683478 12781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.670703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37291 (local address 127.11.225.66:34775)
0811 14:58:11.671182 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:11.671225 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:11.672409 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:11.672922 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:11.672928 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:11.673390 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:11.673918 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.673933 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.674713 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.674715 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.675757 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.675767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.676315 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.676319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.676526 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.677398 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:11.677414 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:11.678818 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:11.680556 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.680562 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.680576 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.680830 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.681112 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.681114 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.681116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.681329 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.681723 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:11.681729 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:11.682016 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 14:58:11.682229 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 14:58:11.682590 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":143,"threads_started":1}
I20260811 14:58:11.684724 12778 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37291
I20260811 14:58:11.684962 12778 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:11.685501 12778 heartbeater.cc:511] Master 127.11.225.126:37291 requested a full tablet report, sending...
I20260811 14:58:11.686511 12247 ts_manager.cc:194] Registered new tserver with Master: dafa596a120f4d0fb5cb62903a5537d9 (127.11.225.66:37789)
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:11.687115 12247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:34775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:11.706282 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:11.823022 12786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:11.823254 12786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:11.823295 12786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:11.827193 12786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:11.827241 12786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:11.827296 12786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:11.832438 12786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37291
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:11.833447 12786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:11.834395 12786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:11.844159 12799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.844192 12796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:11.844168 12795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:11.844537 12786 server_base.cc:1034] running on GCE node
I20260811 14:58:11.844991 12786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:11.845685 12786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:11.846902 12786 hybrid_clock.cc:648] HybridClock initialized: now 1786460291846890 us; error 30 us; skew 500 ppm
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:11.849802 12786 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:11.850780 12786 webserver.cc:460] Webserver started at http://127.11.225.67:41983/ using document root <none> and password file <none>
I20260811 14:58:11.851363 12786 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:11.851469 12786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:11.851703 12786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:11.853888 12786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "7aa1c1e9020f4fd1a14485af9626b137"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "030e3fc4c5a391b4916981d98f2f8f44"
server_key_iv: "510d4021d6eb4e7f1d9867b42b2a7e55"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.854494 12786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "7aa1c1e9020f4fd1a14485af9626b137"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "030e3fc4c5a391b4916981d98f2f8f44"
server_key_iv: "510d4021d6eb4e7f1d9867b42b2a7e55"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.858310 12786 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 14:58:11.860761 12807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.862018 12786 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:58:11.862159 12786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "7aa1c1e9020f4fd1a14485af9626b137"
format_stamp: "Formatted at 2026-08-11 14:58:11 on dist-test-slave-8hhm"
server_key: "030e3fc4c5a391b4916981d98f2f8f44"
server_key_iv: "510d4021d6eb4e7f1d9867b42b2a7e55"
server_key_version: "encryptionkey@0"
I20260811 14:58:11.862272 12786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:11.889647 12786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:11.892616 12786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:11.892828 12786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:11.893584 12786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:11.894490 12786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:11.894563 12786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.894639 12786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:11.894681 12786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:11.904165 12786 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37419
I20260811 14:58:11.904192 12998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37419 every 8 connection(s)
I20260811 14:58:11.905066 12786 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:11.905985 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12786
I20260811 14:58:11.906119 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:11.906405 12165 external_mini_cluster.cc:1428] Setting key 292415eeef89bb9ebb43abf3a505a56e
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:11.918742 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.907164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:56871 (local address 127.11.225.126:37291)
0811 14:58:11.907317 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.907322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.908477 (+ 1155us) server_negotiation.cc:407] Connection header received
0811 14:58:11.909955 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.909958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.910001 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.910068 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.911218 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.911751 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.912875 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.913097 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.913173 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.915578 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.915581 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.915583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.915606 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.916812 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.917352 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.917355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.917356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.917431 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.917772 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.917774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.917775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.917941 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.918014 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.918519 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.918627 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:11.919493 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.907688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37291 (local address 127.11.225.67:56871)
0811 14:58:11.908273 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:11.908357 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:11.909771 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:11.910219 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:11.910226 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:11.910570 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:11.911088 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.911103 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.911866 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.911869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.912763 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:11.912773 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.913272 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.913277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:11.913425 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.913990 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:11.914008 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:11.915411 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:11.916921 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.916926 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.916936 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.917208 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.917529 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:11.917531 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:11.917533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:11.917683 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:11.918042 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:11.918047 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:11.918258 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 14:58:11.918415 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:58:11.918652 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":146,"threads_started":1}
I20260811 14:58:11.920611 13000 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37291
I20260811 14:58:11.920866 13000 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:11.921478 13000 heartbeater.cc:511] Master 127.11.225.126:37291 requested a full tablet report, sending...
I20260811 14:58:11.922461 12247 ts_manager.cc:194] Registered new tserver with Master: 7aa1c1e9020f4fd1a14485af9626b137 (127.11.225.67:37419)
I20260811 14:58:11.923015 12247 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:56871
I20260811 14:58:11.932638 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:11.960240 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.950812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.11.225.65:34681)
0811 14:58:11.951142 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.951163 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.951196 (+ 33us) server_negotiation.cc:407] Connection header received
0811 14:58:11.951248 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.951253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.951435 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.951557 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.952232 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.953013 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.953931 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.954316 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.954413 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.956796 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.956805 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.956818 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.956843 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.958576 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.958988 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.958994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.958996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.959086 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.959340 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.959342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.959343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.959598 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.959764 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.959941 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.960089 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":128,"threads_started":1}
W20260811 14:58:11.961517 12420 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53396
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:58:11 dist-test-slave-8hhm krb5kdc[12179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:11.989295 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:11.980799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53398 (local address 127.11.225.65:34681)
0811 14:58:11.980974 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:11.980978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:11.981049 (+ 71us) server_negotiation.cc:407] Connection header received
0811 14:58:11.981161 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:11.981164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:11.981207 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:11.981338 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:11.982011 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.982540 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.983401 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:11.983627 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:11.983703 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:11.986090 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:11.986093 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:11.986096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:11.986134 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:11.987632 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.988034 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.988037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.988038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.988112 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:11.988406 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:11.988408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:11.988409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:11.988618 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:11.988720 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:11.988951 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 14:58:11.989046 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 14:58:11.990513 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12349
I20260811 14:58:12.004438 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12565
I20260811 14:58:12.027619 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12786
I20260811 14:58:12.041658 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12199
2026-08-11T14:58:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2607 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:12 dist-test-slave-8hhm krb5kdc[13029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:12 dist-test-slave-8hhm krb5kdc[13029](info): set up 2 sockets
Aug 11 14:58:12 dist-test-slave-8hhm krb5kdc[13029](info): commencing operation
krb5kdc: starting...
W20260811 14:58:13.405953 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 14:58:13.619757 12165 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.214s user 0.002s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 14:58:13.790994 12165 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.171s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 14:58:13.963068 12165 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.172s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:13 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:14.028131 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41621
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:14.142872 13047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:14.143141 13047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:14.143179 13047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:14.147197 13047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:14.147254 13047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:14.147272 13047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:14.147289 13047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:14.147302 13047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:14.152570 13047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:14.153728 13047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:14.154793 13047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:14.164427 13057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.164480 13047 server_base.cc:1034] running on GCE node
W20260811 14:58:14.164479 13061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.164718 13058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.165422 13047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:14.166525 13047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:14.167688 13047 hybrid_clock.cc:648] HybridClock initialized: now 1786460294167675 us; error 30 us; skew 500 ppm
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:14.170707 13047 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:14.171634 13047 webserver.cc:460] Webserver started at http://127.11.225.126:46335/ using document root <none> and password file <none>
I20260811 14:58:14.172246 13047 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:14.172340 13047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:14.172583 13047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:14.175182 13047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "0800345ba65640069f2a96a7e76b00ed"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "c3cede86e9ed53ff28fe22bb5d2e56e6"
server_key_iv: "11a25c3faa1da0bb5b21c1e1f7ba7f44"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.175761 13047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "0800345ba65640069f2a96a7e76b00ed"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "c3cede86e9ed53ff28fe22bb5d2e56e6"
server_key_iv: "11a25c3faa1da0bb5b21c1e1f7ba7f44"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.179714 13047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:14.182273 13071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.183538 13047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:14.183686 13047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "0800345ba65640069f2a96a7e76b00ed"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "c3cede86e9ed53ff28fe22bb5d2e56e6"
server_key_iv: "11a25c3faa1da0bb5b21c1e1f7ba7f44"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.183804 13047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:14.217890 13047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:14.221514 13047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:14.221752 13047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:14.229540 13047 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41621
I20260811 14:58:14.229569 13161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41621 every 8 connection(s)
I20260811 14:58:14.230571 13047 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:14.233764 13162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:14.235536 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13047
I20260811 14:58:14.235625 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:14.235908 12165 external_mini_cluster.cc:1428] Setting key e9e4f4acc3c779d502d4089177047ccc
I20260811 14:58:14.240332 13162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed: Bootstrap starting.
I20260811 14:58:14.242848 13162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:14.243666 13162 log.cc:824] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed: Log is configured to *not* fsync() on all Append() calls
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:14.246353 13162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed: No bootstrap required, opened a new log
I20260811 14:58:14.250777 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.237482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46044 (local address 127.11.225.126:41621)
0811 14:58:14.237944 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:14.237959 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:14.237995 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:14.238608 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:14.238624 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:14.238934 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:14.239276 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:14.240060 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.241081 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.241932 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.242440 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.242630 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.245829 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:14.245834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:14.245847 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:14.245873 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:14.247709 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.248280 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.248284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.248289 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.248395 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.248722 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.248724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.248725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.249094 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:14.249306 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:14.249719 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 14:58:14.250021 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":146,"threads_started":1}
I20260811 14:58:14.251536 13162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } }
I20260811 14:58:14.251837 13162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:14.251928 13162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0800345ba65640069f2a96a7e76b00ed, State: Initialized, Role: FOLLOWER
I20260811 14:58:14.252409 13162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } }
I20260811 14:58:14.252592 13162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:14.252691 13162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:14.252827 13162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:14.254036 13162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } }
I20260811 14:58:14.254487 13162 leader_election.cc:302] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0800345ba65640069f2a96a7e76b00ed; no voters:
I20260811 14:58:14.254882 13162 leader_election.cc:288] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:14.255008 13170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:14.255252 13170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [term 1 LEADER]: Becoming Leader. State: Replica: 0800345ba65640069f2a96a7e76b00ed, State: Running, Role: LEADER
I20260811 14:58:14.255592 13170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } }
I20260811 14:58:14.256384 13162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:14.257460 13174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0800345ba65640069f2a96a7e76b00ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } } }
I20260811 14:58:14.257594 13174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:14.257977 13175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0800345ba65640069f2a96a7e76b00ed. Latest consensus state: current_term: 1 leader_uuid: "0800345ba65640069f2a96a7e76b00ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0800345ba65640069f2a96a7e76b00ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41621 } } }
I20260811 14:58:14.258054 13185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:14.258113 13175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:14.261083 13185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:14.266485 13185 catalog_manager.cc:1347] Generated new cluster ID: 4e487715852f41a9bdae4bb592bc6c54
I20260811 14:58:14.266556 13185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:14.286768 13185 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:14.288228 13185 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:14.303218 13185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0800345ba65640069f2a96a7e76b00ed: Generated new TSK 0
I20260811 14:58:14.304062 13185 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:14.344264 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:14.459786 13203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:14.460047 13203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:14.460091 13203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:14.464068 13203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:14.464128 13203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:14.464186 13203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:14.469277 13203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:14.470329 13203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:14.471359 13203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:14.481348 13215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.481508 13203 server_base.cc:1034] running on GCE node
W20260811 14:58:14.481426 13212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.481467 13211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.482102 13203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:14.482752 13203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:14.483911 13203 hybrid_clock.cc:648] HybridClock initialized: now 1786460294483880 us; error 42 us; skew 500 ppm
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:14.486827 13203 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:14.487829 13203 webserver.cc:460] Webserver started at http://127.11.225.65:35021/ using document root <none> and password file <none>
I20260811 14:58:14.488443 13203 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:14.488551 13203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:14.488782 13203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:14.490970 13203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "dc27f47742f0411981540711d782e503"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "1476104fb3618baf71d0b53bdc81cac3"
server_key_iv: "bbc2a2fb73110305bb02bd930a607c05"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.491537 13203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "dc27f47742f0411981540711d782e503"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "1476104fb3618baf71d0b53bdc81cac3"
server_key_iv: "bbc2a2fb73110305bb02bd930a607c05"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.495328 13203 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 14:58:14.497879 13225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.499068 13203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:58:14.499187 13203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "dc27f47742f0411981540711d782e503"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "1476104fb3618baf71d0b53bdc81cac3"
server_key_iv: "bbc2a2fb73110305bb02bd930a607c05"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.499289 13203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:14.519127 13203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:14.522626 13203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:14.522807 13203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:14.523492 13203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:14.524348 13203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:14.524396 13203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.524466 13203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:14.524497 13203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.534001 13203 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:34935
I20260811 14:58:14.534029 13422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:34935 every 8 connection(s)
I20260811 14:58:14.534904 13203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:14.541728 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13203
I20260811 14:58:14.541824 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:14.542079 12165 external_mini_cluster.cc:1428] Setting key 3e5c3a65994ba1855bfa9f11f6abe0e9
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:14.549077 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.536737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:50627 (local address 127.11.225.126:41621)
0811 14:58:14.536875 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:14.536879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:14.537812 (+ 933us) server_negotiation.cc:407] Connection header received
0811 14:58:14.539037 (+ 1225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:14.539040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:14.539086 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:14.539160 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:14.540303 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.540833 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.542013 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.542317 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.542435 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.544983 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:14.544987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:14.544989 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:14.545015 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:14.546856 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.547365 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.547371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.547376 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.547474 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.547807 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.547813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.547818 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.548079 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:14.548198 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:14.548678 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 14:58:14.548824 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:58:14.549842 13428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.537142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41621 (local address 127.11.225.65:50627)
0811 14:58:14.537652 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:14.537703 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:14.538851 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:14.539329 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:14.539336 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:14.539684 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:14.540170 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.540184 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.540940 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.540942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.541882 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.541898 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.542480 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.542484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.542663 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.543259 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:14.543281 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:14.544818 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:14.546983 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.546988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.547002 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.547264 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.547574 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.547576 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.547578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.547711 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.548185 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:14.548190 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:14.548418 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 14:58:14.548583 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 14:58:14.548876 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":121,"threads_started":1}
I20260811 14:58:14.551124 13423 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41621
I20260811 14:58:14.551354 13423 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:14.551857 13423 heartbeater.cc:511] Master 127.11.225.126:41621 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:14.553457 13100 ts_manager.cc:194] Registered new tserver with Master: dc27f47742f0411981540711d782e503 (127.11.225.65:34935)
I20260811 14:58:14.554632 13100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:50627
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:14.572036 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:14.687023 13433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:14.687325 13433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:14.687438 13433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:14.691578 13433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:14.691635 13433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:14.691712 13433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:14.697041 13433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:14.698176 13433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:14.699108 13433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:14.709061 13440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.709056 13447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.709056 13442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.709435 13433 server_base.cc:1034] running on GCE node
I20260811 14:58:14.709868 13433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:14.710495 13433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:14.711680 13433 hybrid_clock.cc:648] HybridClock initialized: now 1786460294711644 us; error 48 us; skew 500 ppm
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:14.714448 13433 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:14.715342 13433 webserver.cc:460] Webserver started at http://127.11.225.66:37291/ using document root <none> and password file <none>
I20260811 14:58:14.715910 13433 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:14.716001 13433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:14.716248 13433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:14.718348 13433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "9df04574f2104a6890fe600deb1fb079"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "7df284a7ed1cb426ce59b3ef497a6d0a"
server_key_iv: "1e3e7670a13c45c7cd9d3aab2d91a1c8"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.718917 13433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "9df04574f2104a6890fe600deb1fb079"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "7df284a7ed1cb426ce59b3ef497a6d0a"
server_key_iv: "1e3e7670a13c45c7cd9d3aab2d91a1c8"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.722623 13433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:14.725077 13456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.726286 13433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:14.726420 13433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "9df04574f2104a6890fe600deb1fb079"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "7df284a7ed1cb426ce59b3ef497a6d0a"
server_key_iv: "1e3e7670a13c45c7cd9d3aab2d91a1c8"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.726536 13433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:14.741690 13433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:14.744691 13433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:14.744903 13433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:14.745589 13433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:14.746448 13433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:14.746519 13433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.746630 13433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:14.746685 13433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.756178 13433 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:46789
I20260811 14:58:14.756218 13634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:46789 every 8 connection(s)
I20260811 14:58:14.757179 13433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:14.758899 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13433
I20260811 14:58:14.759016 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:14.759298 12165 external_mini_cluster.cc:1428] Setting key 57d8ae8dc7369e0ce47399c563504720
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:14.774197 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.759690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41195 (local address 127.11.225.126:41621)
0811 14:58:14.759844 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:14.759849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:14.760586 (+ 737us) server_negotiation.cc:407] Connection header received
0811 14:58:14.762335 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:14.762341 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:14.762405 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:14.762503 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:14.763719 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.764576 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.766839 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.767091 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.767174 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.770348 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:14.770351 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:14.770353 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:14.770376 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:14.771974 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.772569 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.772577 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.772578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.772652 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.773011 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.773014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.773016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.773203 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:14.773363 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:14.773861 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 14:58:14.774008 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:14.775228 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.759827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41621 (local address 127.11.225.66:41195)
0811 14:58:14.760382 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:14.760444 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:14.762112 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:14.762646 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:14.762652 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:14.763041 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:14.763556 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.763571 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.764724 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.764732 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.766680 (+ 1948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.766697 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.767281 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.767289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.767548 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.768238 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:14.768267 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:14.770147 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:14.772113 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.772119 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.772134 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.772459 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.772746 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.772749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.772751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.772908 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.773359 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:14.773366 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:14.773621 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 14:58:14.773802 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 14:58:14.774147 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":119,"threads_started":1}
I20260811 14:58:14.776523 13636 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41621
I20260811 14:58:14.776808 13636 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:14.777482 13636 heartbeater.cc:511] Master 127.11.225.126:41621 requested a full tablet report, sending...
I20260811 14:58:14.778719 13100 ts_manager.cc:194] Registered new tserver with Master: 9df04574f2104a6890fe600deb1fb079 (127.11.225.66:46789)
I20260811 14:58:14.779502 13100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:41195
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:14.792467 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:14.917013 13642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:14.917320 13642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:14.917397 13642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:14.921455 13642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:14.921512 13642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:14.921617 13642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:14.926980 13642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:14.928007 13642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:14.929071 13642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:14.939013 13651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.939033 13657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:14.939007 13654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:14.939395 13642 server_base.cc:1034] running on GCE node
I20260811 14:58:14.939772 13642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:14.940412 13642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:14.941591 13642 hybrid_clock.cc:648] HybridClock initialized: now 1786460294941557 us; error 43 us; skew 500 ppm
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:14.944381 13642 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:14.945201 13642 webserver.cc:460] Webserver started at http://127.11.225.67:45541/ using document root <none> and password file <none>
I20260811 14:58:14.945792 13642 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:14.945852 13642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:14.946024 13642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:14.948135 13642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "ae4b23a19ddc47f39b6a3f7335388a94"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "4b4fbf44b1fdec680b118e0e21d1fd7a"
server_key_iv: "44b7e4975b0f6689c8e6d3937c6b4905"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.948655 13642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "ae4b23a19ddc47f39b6a3f7335388a94"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "4b4fbf44b1fdec680b118e0e21d1fd7a"
server_key_iv: "44b7e4975b0f6689c8e6d3937c6b4905"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.952389 13642 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 14:58:14.954856 13669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.956192 13642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:14.956287 13642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "ae4b23a19ddc47f39b6a3f7335388a94"
format_stamp: "Formatted at 2026-08-11 14:58:14 on dist-test-slave-8hhm"
server_key: "4b4fbf44b1fdec680b118e0e21d1fd7a"
server_key_iv: "44b7e4975b0f6689c8e6d3937c6b4905"
server_key_version: "encryptionkey@0"
I20260811 14:58:14.956372 13642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:14.968724 13642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:14.971920 13642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:14.972076 13642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:14.972674 13642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:14.973559 13642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:14.973608 13642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.973650 13642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:14.973666 13642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:14.983242 13642 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:40247
I20260811 14:58:14.983255 13855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:40247 every 8 connection(s)
I20260811 14:58:14.984192 13642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:14.990305 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13642
I20260811 14:58:14.990410 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:14.990720 12165 external_mini_cluster.cc:1428] Setting key 6165956e9bd7c642213ba4240bfbd750
Aug 11 14:58:14 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:14.998924 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.986180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:47869 (local address 127.11.225.126:41621)
0811 14:58:14.986327 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:14.986330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:14.987208 (+ 878us) server_negotiation.cc:407] Connection header received
0811 14:58:14.988637 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:14.988640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:14.988690 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:14.988766 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:14.990011 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.990656 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.992266 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.992570 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.992685 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.995461 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:14.995464 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:14.995466 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:14.995493 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:14.996967 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.997541 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.997543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.997545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.997623 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:14.997948 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:14.997950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:14.997951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:14.998124 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:14.998204 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:14.998701 (+ 497us) server_negotiation.cc:299] Negotiation successful
0811 14:58:14.998801 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:14.999751 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:14.986521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41621 (local address 127.11.225.67:47869)
0811 14:58:14.986983 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:14.987026 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:14.988427 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:14.988939 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:14.988946 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:14.989362 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:14.989853 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.989867 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.990795 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.990799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.992116 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:14.992128 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:14.992727 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:14.992730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:14.992949 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:14.993747 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:14.993764 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:14.995303 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:14.997086 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.997090 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.997103 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.997447 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.997709 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:14.997711 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:14.997713 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:14.997860 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:14.998213 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:14.998218 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:14.998486 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 14:58:14.998639 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 14:58:14.998890 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":110,"threads_started":1}
I20260811 14:58:15.000907 13859 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41621
I20260811 14:58:15.001155 13859 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:15.001683 13859 heartbeater.cc:511] Master 127.11.225.126:41621 requested a full tablet report, sending...
I20260811 14:58:15.002731 13100 ts_manager.cc:194] Registered new tserver with Master: ae4b23a19ddc47f39b6a3f7335388a94 (127.11.225.67:40247)
I20260811 14:58:15.003360 13100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:47869
I20260811 14:58:15.004959 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:15.016966 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.009313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.11.225.126:41621)
0811 14:58:15.009487 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.009493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.009749 (+ 256us) server_negotiation.cc:407] Connection header received
0811 14:58:15.009820 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.009822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.009865 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.009941 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:15.010627 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.011160 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.011939 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.012164 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.012243 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.013696 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:15.013699 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:15.013701 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:15.013723 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:15.015304 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.015732 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.015735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.015736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.015817 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.016100 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.016102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.016103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.016314 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:15.016417 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.016648 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.016744 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:15.023355 13096 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:15.026842 13096 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:15.043205 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.11.225.67:40247)
0811 14:58:15.038655 (+ 1358us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.038673 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.038696 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:58:15.038769 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.038774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.038945 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.039085 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:15.039425 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040188 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.041830 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.042478 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.042615 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.042837 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.042948 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.043052 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":124,"threads_started":1}
I20260811 14:58:15.043195 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:40247 (local address 127.0.0.1:35890)
0811 14:58:15.038326 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:15.038338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:15.038417 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:15.039113 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:15.039116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:15.039137 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:15.039287 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.039297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040323 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.040328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.041695 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.041706 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.042612 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.042616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.042754 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.042797 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:58:15.042920 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 14:58:15.043041 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":306,"thread_start_us":122,"threads_started":1}
I20260811 14:58:15.043433 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:46789 (local address 127.0.0.1:40108)
0811 14:58:15.037959 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:15.038012 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:15.038152 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:15.038910 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:15.038919 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:15.038948 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:15.039117 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.039127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040668 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.040671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.041946 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.041954 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.043046 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.043050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.043144 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.043177 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 14:58:15.043229 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 14:58:15.043298 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"mutex_wait_us":301,"spinlock_wait_cycles":7424,"thread_start_us":85,"threads_started":1}
I20260811 14:58:15.043869 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:34935 (local address 127.0.0.1:57756)
0811 14:58:15.037959 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:15.038012 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:15.038152 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:15.039162 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:15.039168 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:15.039192 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:15.039306 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.039311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040707 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.040710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.041910 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.041921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.043207 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.043213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.043519 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.043570 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 14:58:15.043649 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:58:15.043727 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":21,"spinlock_wait_cycles":6272,"thread_start_us":103,"threads_started":1}
I20260811 14:58:15.043948 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.11.225.65:34935)
0811 14:58:15.038456 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.038479 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.038506 (+ 27us) server_negotiation.cc:407] Connection header received
0811 14:58:15.038612 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.038619 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.038816 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.038987 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:15.039448 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040574 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.042047 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.042887 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.043006 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.043146 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.043703 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.043802 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":62,"threads_started":1}
I20260811 14:58:15.044328 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.037686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.11.225.66:46789)
0811 14:58:15.038390 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.038402 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.038426 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:58:15.038510 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.038515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.038736 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.038896 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:15.039264 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.040517 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.042107 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.042887 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.043836 (+ 949us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.044012 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.044073 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.044165 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":143,"threads_started":1}
I20260811 14:58:15.046815 13534 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa456d4cf6248c7a61f683661c995cd (DEFAULT_TABLE table=test-table [id=5918cfa148ee473c9c0d727eab959fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:15.046885 13310 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa456d4cf6248c7a61f683661c995cd (DEFAULT_TABLE table=test-table [id=5918cfa148ee473c9c0d727eab959fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:15.046885 13754 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa456d4cf6248c7a61f683661c995cd (DEFAULT_TABLE table=test-table [id=5918cfa148ee473c9c0d727eab959fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:15.047953 13534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa456d4cf6248c7a61f683661c995cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:15.049386 13310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa456d4cf6248c7a61f683661c995cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:15.049959 13754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa456d4cf6248c7a61f683661c995cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:15.054829 13889 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Bootstrap starting.
I20260811 14:58:15.056596 13890 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Bootstrap starting.
I20260811 14:58:15.057623 13891 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Bootstrap starting.
I20260811 14:58:15.058075 13889 tablet_bootstrap.cc:654] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:15.059141 13890 tablet_bootstrap.cc:654] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:15.059211 13889 log.cc:824] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:15.059801 13891 tablet_bootstrap.cc:654] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:15.060096 13890 log.cc:824] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:15.061205 13891 log.cc:824] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:15.061710 13889 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: No bootstrap required, opened a new log
I20260811 14:58:15.061933 13889 ts_tablet_manager.cc:1397] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 14:58:15.062171 13890 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: No bootstrap required, opened a new log
I20260811 14:58:15.062379 13890 ts_tablet_manager.cc:1397] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 14:58:15.063314 13891 tablet_bootstrap.cc:492] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: No bootstrap required, opened a new log
I20260811 14:58:15.063493 13891 ts_tablet_manager.cc:1397] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260811 14:58:15.065879 13890 raft_consensus.cc:348] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.066061 13889 raft_consensus.cc:348] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.066283 13890 raft_consensus.cc:374] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:15.066381 13890 raft_consensus.cc:729] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc27f47742f0411981540711d782e503, State: Initialized, Role: FOLLOWER
I20260811 14:58:15.066390 13889 raft_consensus.cc:374] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:15.066445 13889 raft_consensus.cc:729] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9df04574f2104a6890fe600deb1fb079, State: Initialized, Role: FOLLOWER
I20260811 14:58:15.066941 13890 consensus_queue.cc:260] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.066938 13889 consensus_queue.cc:260] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.067330 13891 raft_consensus.cc:348] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.067690 13891 raft_consensus.cc:374] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:15.067749 13423 heartbeater.cc:503] Master 127.11.225.126:41621 was elected leader, sending a full tablet report...
I20260811 14:58:15.067786 13891 raft_consensus.cc:729] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4b23a19ddc47f39b6a3f7335388a94, State: Initialized, Role: FOLLOWER
I20260811 14:58:15.068049 13889 ts_tablet_manager.cc:1428] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:58:15.068025 13890 ts_tablet_manager.cc:1428] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:58:15.068414 13636 heartbeater.cc:503] Master 127.11.225.126:41621 was elected leader, sending a full tablet report...
I20260811 14:58:15.069308 13891 consensus_queue.cc:260] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.070155 13891 ts_tablet_manager.cc:1428] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260811 14:58:15.071691 13859 heartbeater.cc:503] Master 127.11.225.126:41621 was elected leader, sending a full tablet report...
W20260811 14:58:15.235255 13860 tablet.cc:2369] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:15.258466 13638 tablet.cc:2369] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:15.261543 13900 raft_consensus.cc:482] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:15.261803 13900 raft_consensus.cc:504] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.263000 13900 leader_election.cc:288] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae4b23a19ddc47f39b6a3f7335388a94 (127.11.225.67:40247), 9df04574f2104a6890fe600deb1fb079 (127.11.225.66:46789)
I20260811 14:58:15.267153 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.263468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:34463 (local address 127.11.225.66:46789)
0811 14:58:15.263653 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.263657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.263863 (+ 206us) server_negotiation.cc:407] Connection header received
0811 14:58:15.264051 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.264054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.264116 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.264206 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:15.264508 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.265006 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.266191 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.266594 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.266723 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.266779 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.266959 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.267028 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 14:58:15.267182 13905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.263324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:46789 (local address 127.11.225.65:34463)
0811 14:58:15.263763 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:15.263775 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:15.263938 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:15.264220 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:15.264223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:15.264239 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:15.264395 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.264401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.265125 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.265128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.266040 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.266049 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.266720 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.266723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.266822 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.266844 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 14:58:15.266942 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 14:58:15.267009 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":3,"thread_start_us":143,"threads_started":1}
I20260811 14:58:15.267737 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.263481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:40509 (local address 127.11.225.67:40247)
0811 14:58:15.263650 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.263657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.263997 (+ 340us) server_negotiation.cc:407] Connection header received
0811 14:58:15.264166 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.264169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.264218 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.264313 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:15.264716 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.265354 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.266620 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.267079 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.267235 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.267297 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.267526 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.267616 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 14:58:15.267759 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.263324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:40247 (local address 127.11.225.65:40509)
0811 14:58:15.263825 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:15.263839 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:15.264007 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:15.264341 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:15.264345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:15.264364 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:15.264578 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.264585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.265497 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.265502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.266463 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:15.266474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.267229 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.267242 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:15.267363 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.267391 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 14:58:15.267508 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 14:58:15.267584 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":109,"thread_start_us":168,"threads_started":1}
I20260811 14:58:15.268046 13570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa456d4cf6248c7a61f683661c995cd" candidate_uuid: "dc27f47742f0411981540711d782e503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9df04574f2104a6890fe600deb1fb079" is_pre_election: true
I20260811 14:58:15.268489 13570 raft_consensus.cc:2454] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc27f47742f0411981540711d782e503 in term 0.
I20260811 14:58:15.268488 13784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa456d4cf6248c7a61f683661c995cd" candidate_uuid: "dc27f47742f0411981540711d782e503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" is_pre_election: true
I20260811 14:58:15.268787 13784 raft_consensus.cc:2454] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc27f47742f0411981540711d782e503 in term 0.
I20260811 14:58:15.269183 13235 leader_election.cc:302] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9df04574f2104a6890fe600deb1fb079, dc27f47742f0411981540711d782e503; no voters:
I20260811 14:58:15.269560 13900 raft_consensus.cc:2781] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:15.269663 13900 raft_consensus.cc:482] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:15.269719 13900 raft_consensus.cc:3037] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:15.270787 13900 raft_consensus.cc:504] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.271184 13900 leader_election.cc:288] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [CANDIDATE]: Term 1 election: Requested vote from peers ae4b23a19ddc47f39b6a3f7335388a94 (127.11.225.67:40247), 9df04574f2104a6890fe600deb1fb079 (127.11.225.66:46789)
I20260811 14:58:15.271615 13784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa456d4cf6248c7a61f683661c995cd" candidate_uuid: "dc27f47742f0411981540711d782e503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae4b23a19ddc47f39b6a3f7335388a94"
I20260811 14:58:15.271689 13570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aa456d4cf6248c7a61f683661c995cd" candidate_uuid: "dc27f47742f0411981540711d782e503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9df04574f2104a6890fe600deb1fb079"
I20260811 14:58:15.271792 13784 raft_consensus.cc:3037] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:15.271867 13570 raft_consensus.cc:3037] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:15.272915 13784 raft_consensus.cc:2454] T 8aa456d4cf6248c7a61f683661c995cd P ae4b23a19ddc47f39b6a3f7335388a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc27f47742f0411981540711d782e503 in term 1.
I20260811 14:58:15.273001 13570 raft_consensus.cc:2454] T 8aa456d4cf6248c7a61f683661c995cd P 9df04574f2104a6890fe600deb1fb079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc27f47742f0411981540711d782e503 in term 1.
I20260811 14:58:15.273337 13235 leader_election.cc:302] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9df04574f2104a6890fe600deb1fb079, dc27f47742f0411981540711d782e503; no voters:
I20260811 14:58:15.273502 13900 raft_consensus.cc:2781] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:15.273751 13900 raft_consensus.cc:686] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [term 1 LEADER]: Becoming Leader. State: Replica: dc27f47742f0411981540711d782e503, State: Running, Role: LEADER
I20260811 14:58:15.274116 13900 consensus_queue.cc:237] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } }
I20260811 14:58:15.277496 13095 catalog_manager.cc:5495] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc27f47742f0411981540711d782e503 (127.11.225.65). New cstate: current_term: 1 leader_uuid: "dc27f47742f0411981540711d782e503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae4b23a19ddc47f39b6a3f7335388a94" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc27f47742f0411981540711d782e503" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9df04574f2104a6890fe600deb1fb079" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 46789 } health_report { overall_health: UNKNOWN } } }
W20260811 14:58:15.286281 13425 tablet.cc:2369] T 8aa456d4cf6248c7a61f683661c995cd P dc27f47742f0411981540711d782e503: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460293, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:15.339339 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.330045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.11.225.65:34935)
0811 14:58:15.330222 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.330227 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.330369 (+ 142us) server_negotiation.cc:407] Connection header received
0811 14:58:15.330542 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.330546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.330601 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.330695 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:15.331419 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.331934 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.332811 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.333028 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.333145 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.335752 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:15.335766 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:15.335783 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:15.335806 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:15.337525 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.337970 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.337976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.337977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.338083 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.338370 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.338374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.338376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.338642 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:15.338880 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.339050 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.339174 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460295, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460295, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:15.369096 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.360422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57772 (local address 127.11.225.65:34935)
0811 14:58:15.360616 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.360621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.360764 (+ 143us) server_negotiation.cc:407] Connection header received
0811 14:58:15.360894 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.360897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.360945 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.361028 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:15.361783 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.362336 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.363137 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.363357 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.363435 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.365882 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:15.365885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:15.365887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:15.365911 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:15.367377 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.367819 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.367827 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.367828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.367909 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.368196 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.368200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.368202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.368369 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:15.368510 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.368801 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.368924 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460295, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:15.397135 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:15.388534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57786 (local address 127.11.225.65:34935)
0811 14:58:15.388669 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:15.388674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:15.388850 (+ 176us) server_negotiation.cc:407] Connection header received
0811 14:58:15.389018 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:15.389021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:15.389065 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:15.389163 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:15.389895 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.390427 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.391269 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:15.391488 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:15.391598 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:15.394078 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:15.394094 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:15.394096 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:15.394121 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:15.395442 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.395875 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.395879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.395881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.395976 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:15.396279 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:15.396282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:15.396284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:15.396454 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:15.396613 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:15.396839 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 14:58:15.396958 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 14:58:15.398830 13281 tablet_service.cc:2908] Rejecting scan request for tablet 8aa456d4cf6248c7a61f683661c995cd: Uninitialized: clean time has not yet been initialized
I20260811 14:58:15.401166 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13203
I20260811 14:58:15.416160 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13433
I20260811 14:58:15.428275 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13642
I20260811 14:58:15.449340 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13047
2026-08-11T14:58:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3404 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13924](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13924](info): set up 2 sockets
Aug 11 14:58:15 dist-test-slave-8hhm krb5kdc[13924](info): commencing operation
krb5kdc: starting...
W20260811 14:58:16.740433 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:16 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:16.869340 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:37251
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:37251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:16.992565 13944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:16.992826 13944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:16.992866 13944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:16.996960 13944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:16.997020 13944 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:58:16.997037 13944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:16.997056 13944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:16.997071 13944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:16.997087 13944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:17.002409 13944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:37251
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:37251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:17.003430 13944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:17.004426 13944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:17.013377 13956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.013414 13951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:17.013587 13944 server_base.cc:1034] running on GCE node
W20260811 14:58:17.013682 13960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:17.014305 13944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:17.015398 13944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:17.016567 13944 hybrid_clock.cc:648] HybridClock initialized: now 1786460297016525 us; error 54 us; skew 500 ppm
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:17.019573 13944 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:17.020536 13944 webserver.cc:460] Webserver started at http://127.11.225.126:44909/ using document root <none> and password file <none>
I20260811 14:58:17.021159 13944 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:17.021283 13944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:17.021538 13944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:17.023578 13944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "f2761140d0ce4173ad57676161a313a6"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "cc2ad4c2ac8e538461f3c7a18d3f8457"
server_key_iv: "6e49a00b529d509d5b12895848f9251c"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.024187 13944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "f2761140d0ce4173ad57676161a313a6"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "cc2ad4c2ac8e538461f3c7a18d3f8457"
server_key_iv: "6e49a00b529d509d5b12895848f9251c"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.028158 13944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 14:58:17.030654 13971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.031873 13944 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:17.032045 13944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "f2761140d0ce4173ad57676161a313a6"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "cc2ad4c2ac8e538461f3c7a18d3f8457"
server_key_iv: "6e49a00b529d509d5b12895848f9251c"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.032166 13944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:17.049986 13944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:17.053122 13944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:17.053359 13944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:17.062130 13944 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:37251
I20260811 14:58:17.062151 14065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:37251 every 8 connection(s)
I20260811 14:58:17.063134 13944 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:17.066131 14066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:17.066738 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13944
I20260811 14:58:17.066835 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:17.067118 12165 external_mini_cluster.cc:1428] Setting key e600fee886a479ae4bd9ed8ba715ae7d
I20260811 14:58:17.072988 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Bootstrap starting.
I20260811 14:58:17.075693 14066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:17.076572 14066 log.cc:824] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Log is configured to *not* fsync() on all Append() calls
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:17.079156 14066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: No bootstrap required, opened a new log
I20260811 14:58:17.083225 14066 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } }
I20260811 14:58:17.083487 14066 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:17.083552 14066 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2761140d0ce4173ad57676161a313a6, State: Initialized, Role: FOLLOWER
I20260811 14:58:17.083667 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.068586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40670 (local address 127.11.225.126:37251)
0811 14:58:17.069067 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.069087 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.069133 (+ 46us) server_negotiation.cc:407] Connection header received
0811 14:58:17.070005 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.070028 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.070455 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.070834 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.071523 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.073030 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.073998 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.074717 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.074885 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.077742 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.077749 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.077766 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.077795 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.080504 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.080966 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.080974 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.080981 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.081135 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.081476 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.081480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.081482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.081993 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.082207 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.082409 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.082713 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":103,"threads_started":1}
I20260811 14:58:17.084069 14066 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } }
I20260811 14:58:17.084259 14066 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:17.084318 14066 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:17.084491 14066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:17.085505 14066 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } }
I20260811 14:58:17.085878 14066 leader_election.cc:302] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2761140d0ce4173ad57676161a313a6; no voters:
I20260811 14:58:17.086220 14066 leader_election.cc:288] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:17.086364 14072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:17.086632 14072 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [term 1 LEADER]: Becoming Leader. State: Replica: f2761140d0ce4173ad57676161a313a6, State: Running, Role: LEADER
I20260811 14:58:17.086966 14072 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } }
I20260811 14:58:17.087424 14066 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:17.088694 14077 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2761140d0ce4173ad57676161a313a6. Latest consensus state: current_term: 1 leader_uuid: "f2761140d0ce4173ad57676161a313a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } } }
I20260811 14:58:17.088822 14077 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:17.089074 14076 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2761140d0ce4173ad57676161a313a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2761140d0ce4173ad57676161a313a6" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 37251 } } }
I20260811 14:58:17.089226 14076 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:17.089336 14087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:17.092351 14087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:17.097847 14087 catalog_manager.cc:1347] Generated new cluster ID: 9756681a178f4fdc9ac059838d71ea5d
I20260811 14:58:17.097913 14087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:17.105603 14087 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:17.106650 14087 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:17.114015 14087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Generated new TSK 0
I20260811 14:58:17.114840 14087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:17.150455 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37251
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:17.266513 14105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:17.266834 14105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:17.266938 14105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:17.270947 14105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:17.271039 14105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:17.271112 14105 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:17.271191 14105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:17.276507 14105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:37251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:17.277648 14105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:17.278685 14105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:17.288470 14120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.288487 14118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.288487 14122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:17.288743 14105 server_base.cc:1034] running on GCE node
I20260811 14:58:17.289258 14105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:17.289913 14105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:17.291074 14105 hybrid_clock.cc:648] HybridClock initialized: now 1786460297291056 us; error 27 us; skew 500 ppm
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:17.293987 14105 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:17.294991 14105 webserver.cc:460] Webserver started at http://127.11.225.65:37803/ using document root <none> and password file <none>
I20260811 14:58:17.295589 14105 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:17.295689 14105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:17.295935 14105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:17.298169 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "7f6b3ca7f9744a4d8efa59c824ba527f"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "457d4289cad7ce610d73cee07b3aca87"
server_key_iv: "ed54d1f453d525ddc42533ca331381ec"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.298774 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "7f6b3ca7f9744a4d8efa59c824ba527f"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "457d4289cad7ce610d73cee07b3aca87"
server_key_iv: "ed54d1f453d525ddc42533ca331381ec"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.302668 14105 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:58:17.305358 14133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.306718 14105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:17.306852 14105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "7f6b3ca7f9744a4d8efa59c824ba527f"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "457d4289cad7ce610d73cee07b3aca87"
server_key_iv: "ed54d1f453d525ddc42533ca331381ec"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.306962 14105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:17.333349 14105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:17.336575 14105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:17.336823 14105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:17.338500 14105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:17.338580 14105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.338658 14105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:17.338698 14105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:17.350282 14105 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:41903
I20260811 14:58:17.350371 14329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:41903 every 8 connection(s)
I20260811 14:58:17.351449 14105 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:17.353865 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.339230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:58905 (local address 127.11.225.126:37251)
0811 14:58:17.339361 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.339365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.341357 (+ 1992us) server_negotiation.cc:407] Connection header received
0811 14:58:17.342734 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.342739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.342807 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.342908 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.344741 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.345570 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.346814 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.347217 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.347352 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.350228 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.350231 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.350234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.350265 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.351854 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.352458 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.352462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.352464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.352585 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.352874 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.352876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.352877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.353051 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.353125 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.353637 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.353744 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:58:17.354651 14150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.340526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.65:58905)
0811 14:58:17.341152 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.341241 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.342473 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.343158 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.343169 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.343743 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.344541 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.344567 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.345704 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.345707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.346668 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.346682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.347378 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.347381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.347522 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.348214 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.348237 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.350033 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.351993 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.351999 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.352013 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.352350 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.352677 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.352679 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.352681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.352812 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.353137 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.353142 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.353412 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.353578 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.353815 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":119,"threads_started":1}
I20260811 14:58:17.356031 14330 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37251
I20260811 14:58:17.356204 14330 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:17.356704 14330 heartbeater.cc:511] Master 127.11.225.126:37251 requested a full tablet report, sending...
I20260811 14:58:17.358228 13995 ts_manager.cc:194] Registered new tserver with Master: 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903)
I20260811 14:58:17.358438 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14105
I20260811 14:58:17.358551 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:17.358850 12165 external_mini_cluster.cc:1428] Setting key 6f5768a3e0fde44b2759e4ca5110e0ad
I20260811 14:58:17.359570 13995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:58905
I20260811 14:58:17.366580 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.359252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:55923 (local address 127.11.225.126:37251)
0811 14:58:17.359398 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.359401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.359413 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:17.359446 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.359449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.359502 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.359605 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.360066 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.360700 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.361738 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.361968 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.362076 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.363182 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.363185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.363188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.363213 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.364701 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.365267 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.365270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.365272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.365355 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.365720 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.365722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.365723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.365963 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.366056 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.366375 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.366465 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:17.366777 14337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.358359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.65:55923)
0811 14:58:17.358671 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.358686 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.358769 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.359624 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.359627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.359827 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.359918 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.359923 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.360843 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.360847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.361612 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.361623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.362093 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.362096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.362197 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.362693 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.362704 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.363034 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.364820 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.364826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.364831 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.365117 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.365485 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.365492 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.365496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.365616 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.366083 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.366089 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.366201 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.366324 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.366480 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":63,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:17.388877 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37251
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:17.502110 14341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:17.502349 14341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:17.502391 14341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:17.506327 14341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:17.506386 14341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:17.506453 14341 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:17.506528 14341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:17.511623 14341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:37251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:17.512641 14341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:17.513695 14341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:17.523597 14354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.523582 14349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.523597 14350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:17.523849 14341 server_base.cc:1034] running on GCE node
I20260811 14:58:17.524345 14341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:17.525007 14341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:17.526170 14341 hybrid_clock.cc:648] HybridClock initialized: now 1786460297526135 us; error 42 us; skew 500 ppm
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:17.529096 14341 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:17.530046 14341 webserver.cc:460] Webserver started at http://127.11.225.66:43123/ using document root <none> and password file <none>
I20260811 14:58:17.530655 14341 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:17.530756 14341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:17.531005 14341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:17.533133 14341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "4131592b51df482388d8f8fd9b2461e4"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "41f755064f990266f384cf6320f1f120"
server_key_iv: "f6bb2f4eb268acab8627209f60a58209"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.533828 14341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "4131592b51df482388d8f8fd9b2461e4"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "41f755064f990266f384cf6320f1f120"
server_key_iv: "f6bb2f4eb268acab8627209f60a58209"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.537832 14341 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 14:58:17.540421 14368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.541751 14341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:17.541893 14341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "4131592b51df482388d8f8fd9b2461e4"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "41f755064f990266f384cf6320f1f120"
server_key_iv: "f6bb2f4eb268acab8627209f60a58209"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.542044 14341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:17.552491 14341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:17.555891 14341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:17.556090 14341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:17.557873 14341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:17.557937 14341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.557988 14341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:17.558017 14341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:17.569880 14341 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:38885
I20260811 14:58:17.569942 14570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:38885 every 8 connection(s)
I20260811 14:58:17.570966 14341 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:17.572543 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.558457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:53855 (local address 127.11.225.126:37251)
0811 14:58:17.558593 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.558597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.560285 (+ 1688us) server_negotiation.cc:407] Connection header received
0811 14:58:17.561639 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.561643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.561707 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.561825 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.563153 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.563690 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.564848 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.565152 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.565435 (+ 283us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.568680 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.568702 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.568705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.568736 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.570458 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.570953 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.570956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.570958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.571063 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.571452 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.571455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.571457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.571711 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.571832 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.572310 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.572411 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:58:17.573370 14382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.559556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.66:53855)
0811 14:58:17.560100 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.560167 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.561409 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.562013 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.562020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.562484 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.562998 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.563014 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.563823 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.563827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.564708 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.564719 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.565515 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.565521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.565765 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.566450 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.566475 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.568503 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.570570 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.570574 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.570585 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.570844 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.571152 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.571155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.571157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.571303 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.571832 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.571840 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.572085 (+ 245us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.572241 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.572475 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":144,"threads_started":1}
I20260811 14:58:17.574503 14571 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37251
I20260811 14:58:17.574644 14571 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:17.575232 14571 heartbeater.cc:511] Master 127.11.225.126:37251 requested a full tablet report, sending...
I20260811 14:58:17.575663 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14341
I20260811 14:58:17.575780 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:17.576117 12165 external_mini_cluster.cc:1428] Setting key 6bdd7f2c65b3284cd9aee5490adbdb0a
I20260811 14:58:17.576367 13996 ts_manager.cc:194] Registered new tserver with Master: 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885)
I20260811 14:58:17.577144 13996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:53855
I20260811 14:58:17.584865 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.576890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.66:49773)
0811 14:58:17.577321 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.577336 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.577431 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.577776 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.577778 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.577929 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.578016 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.578022 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.579034 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.579036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.579640 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.579653 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.580196 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.580201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.580376 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.580896 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.580917 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.581387 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.583214 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.583221 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.583224 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.583484 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.583781 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.583784 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.583786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.583902 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.584455 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.584457 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.584541 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.584620 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.584720 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":3,"thread_start_us":205,"threads_started":1}
I20260811 14:58:17.585070 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.576936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49773 (local address 127.11.225.126:37251)
0811 14:58:17.577038 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.577042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.577419 (+ 377us) server_negotiation.cc:407] Connection header received
0811 14:58:17.577553 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.577556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.577598 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.577651 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.578132 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.578899 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.579777 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.580068 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.580172 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.581524 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.581527 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.581529 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.581549 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.583096 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.583608 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.583610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.583611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.583684 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.584006 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.584009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.584011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.584343 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.584460 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.584720 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.584857 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:17.607777 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:37251
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:17.725054 14588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:17.725383 14588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:17.725448 14588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:17.729424 14588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:17.729475 14588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:17.729516 14588 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:17.729585 14588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:17.734993 14588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:37251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:17.737422 14588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:17.742132 14588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:17.775563 14601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.775561 14597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:17.775561 14596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:17.776474 14588 server_base.cc:1034] running on GCE node
I20260811 14:58:17.778126 14588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:17.780234 14588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:17.783903 14588 hybrid_clock.cc:648] HybridClock initialized: now 1786460297783794 us; error 108 us; skew 500 ppm
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:17.794749 14588 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:17.798645 14588 webserver.cc:460] Webserver started at http://127.11.225.67:41269/ using document root <none> and password file <none>
I20260811 14:58:17.800851 14588 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:17.801138 14588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:17.802364 14588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:17.813071 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "cd2cbe593a0b4d44a150959a1cde14ab"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "9afbdcf472b84bd14b7730388494bcc4"
server_key_iv: "d864e1d97e0c6e77c458fd9a8c3a3fe6"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.815233 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "cd2cbe593a0b4d44a150959a1cde14ab"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "9afbdcf472b84bd14b7730388494bcc4"
server_key_iv: "d864e1d97e0c6e77c458fd9a8c3a3fe6"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.834703 14588 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.018s sys 0.000s
I20260811 14:58:17.847375 14614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:17.853736 14588 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.008s sys 0.000s
I20260811 14:58:17.854200 14588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "cd2cbe593a0b4d44a150959a1cde14ab"
format_stamp: "Formatted at 2026-08-11 14:58:17 on dist-test-slave-8hhm"
server_key: "9afbdcf472b84bd14b7730388494bcc4"
server_key_iv: "d864e1d97e0c6e77c458fd9a8c3a3fe6"
server_key_version: "encryptionkey@0"
I20260811 14:58:17.854691 14588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:17.911382 14588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:17.923703 14588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:17.924425 14588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:17.929304 14588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:17.929468 14588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260811 14:58:17.929678 14588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:17.929842 14588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:17.946293 14588 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:44099
I20260811 14:58:17.947098 14807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:44099 every 8 connection(s)
I20260811 14:58:17.947252 14588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:17.949122 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.933586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:42053 (local address 127.11.225.126:37251)
0811 14:58:17.934011 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.934043 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.936522 (+ 2479us) server_negotiation.cc:407] Connection header received
0811 14:58:17.938121 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.938127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.938196 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.938293 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.939589 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.940128 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.941459 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.941809 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.941935 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.945160 (+ 3225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.945164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.945167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.945198 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.946874 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.947462 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.947466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.947467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.947579 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.947975 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.947979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.947981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.948225 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.948321 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.948820 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.948942 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260811 14:58:17.949893 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.935146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.67:42053)
0811 14:58:17.936299 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.936390 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.937801 (+ 1411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.938506 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.938513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.938918 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.939417 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.939431 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.940263 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.940271 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.941258 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.941291 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.941985 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.942009 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.942239 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.942948 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.942968 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.944982 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.946993 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.947002 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.947019 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.947358 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.947676 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.947679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.947682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.947865 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.948328 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.948336 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.948582 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.948768 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.949070 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"thread_start_us":521,"threads_started":1}
I20260811 14:58:17.951030 14808 heartbeater.cc:347] Connected to a master server at 127.11.225.126:37251
I20260811 14:58:17.951231 14808 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:17.951510 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14588
I20260811 14:58:17.951642 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:17.951887 14808 heartbeater.cc:511] Master 127.11.225.126:37251 requested a full tablet report, sending...
I20260811 14:58:17.951972 12165 external_mini_cluster.cc:1428] Setting key b0d1f6de589261fb615d1a12aebe96ee
I20260811 14:58:17.952999 13995 ts_manager.cc:194] Registered new tserver with Master: cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67:44099)
I20260811 14:58:17.953764 13995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:42053
I20260811 14:58:17.954312 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:17.961159 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.953657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.11.225.67:54803)
0811 14:58:17.953919 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.953935 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:17.954036 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:17.954381 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:17.954409 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:17.954597 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:17.954690 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.954696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.955437 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.955441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.956079 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:17.956088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.956595 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.956600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:17.956697 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.957230 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:17.957248 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:17.957576 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:17.959604 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.959607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.959608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.959820 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.960185 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:17.960187 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:17.960188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:17.960271 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:17.960747 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:17.960749 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:17.960826 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 14:58:17.960906 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:58:17.961003 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":105,"threads_started":1}
I20260811 14:58:17.961479 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.953705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:54803 (local address 127.11.225.126:37251)
0811 14:58:17.953939 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.953943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.954000 (+ 57us) server_negotiation.cc:407] Connection header received
0811 14:58:17.954151 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.954155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.954199 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.954252 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.954805 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.955304 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.956200 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.956464 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.956576 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.957713 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.957717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.957719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.957743 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.959486 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.959931 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.959937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.959942 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.960078 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.960370 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.960375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.960379 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.960636 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.960743 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.961007 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.961134 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:58:17 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:17.984061 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.975043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40684 (local address 127.11.225.126:37251)
0811 14:58:17.975187 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.975191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:17.975203 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:17.975239 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:17.975241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:17.975288 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:17.975380 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:17.976071 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.976607 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.977626 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:17.977845 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:17.977937 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:17.980456 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:17.980459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:17.980462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:17.980487 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:17.982190 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.982615 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.982618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.982619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.982701 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:17.983008 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:17.983011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:17.983012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:17.983196 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:17.983344 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:17.983700 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 14:58:17.983795 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 14:58:17.987064 13995 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:17.990404 13995 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:18.005806 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.999058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41903 (local address 127.0.0.1:36774)
0811 14:58:17.999935 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:17.999994 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.000152 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.001309 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.001315 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.001336 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.001436 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.001442 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.002631 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.002637 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.004294 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.004306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.005176 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.005180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.005331 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.005374 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.005520 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.005656 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"mutex_wait_us":73,"thread_start_us":86,"threads_started":1}
I20260811 14:58:18.005806 14838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.999217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36774 (local address 127.11.225.65:41903)
0811 14:58:18.000851 (+ 1634us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.000868 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.000893 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:58:18.000964 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.000969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.001150 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.001346 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.001543 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.002499 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.004472 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.005027 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.005167 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.005396 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.005556 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.005663 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1508,"thread_start_us":99,"threads_started":1}
I20260811 14:58:18.006489 14839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.999884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:44099 (local address 127.0.0.1:49016)
0811 14:58:18.000435 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.000450 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.000554 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.001533 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.001536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.001570 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.001687 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.001693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.003191 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.003196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.004271 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.004282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.005796 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.005800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.006166 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.006200 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.006275 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.006346 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":3,"thread_start_us":157,"threads_started":1}
I20260811 14:58:18.006999 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.000078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49016 (local address 127.11.225.67:44099)
0811 14:58:18.000794 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.000807 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.000832 (+ 25us) server_negotiation.cc:407] Connection header received
0811 14:58:18.000922 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.000929 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.001151 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.001346 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.001826 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.003036 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.004421 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.005420 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.005538 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.005731 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.006735 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.006846 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":117,"threads_started":1}
I20260811 14:58:18.007820 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.999058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38885 (local address 127.0.0.1:52326)
0811 14:58:18.000158 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.000174 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.000284 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.001066 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.001072 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.001091 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.001185 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.001190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.002648 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.002651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.005569 (+ 2918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.005581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.007407 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.007410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.007477 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.007495 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.007603 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.007682 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"mutex_wait_us":1680,"thread_start_us":105,"threads_started":1}
I20260811 14:58:18.007895 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:17.999328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52326 (local address 127.11.225.66:38885)
0811 14:58:17.999706 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:17.999716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.000386 (+ 670us) server_negotiation.cc:407] Connection header received
0811 14:58:18.000474 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.000478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.000708 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.000871 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.001358 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.002511 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.005725 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.007072 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.007189 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.007348 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.007652 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.007748 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":111,"threads_started":1}
I20260811 14:58:18.009027 14222 tablet_service.cc:1467] Processing CreateTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 (DEFAULT_TABLE table=test-table [id=9bfc9f7f9818450181718b353dc99651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.010289 14222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eb89051021f48dbbbcfa33f20fe7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.010707 14450 tablet_service.cc:1467] Processing CreateTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 (DEFAULT_TABLE table=test-table [id=9bfc9f7f9818450181718b353dc99651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.011291 14695 tablet_service.cc:1467] Processing CreateTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 (DEFAULT_TABLE table=test-table [id=9bfc9f7f9818450181718b353dc99651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.011703 14450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eb89051021f48dbbbcfa33f20fe7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.012275 14695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4eb89051021f48dbbbcfa33f20fe7020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.017972 14847 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Bootstrap starting.
I20260811 14:58:18.019423 14848 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Bootstrap starting.
I20260811 14:58:18.020511 14850 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Bootstrap starting.
I20260811 14:58:18.021166 14847 tablet_bootstrap.cc:654] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.021473 14848 tablet_bootstrap.cc:654] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.022223 14848 log.cc:824] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:18.022274 14847 log.cc:824] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:18.022873 14850 tablet_bootstrap.cc:654] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.023602 14850 log.cc:824] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:18.024248 14848 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: No bootstrap required, opened a new log
I20260811 14:58:18.024248 14847 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: No bootstrap required, opened a new log
I20260811 14:58:18.024443 14847 ts_tablet_manager.cc:1397] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 14:58:18.024443 14848 ts_tablet_manager.cc:1397] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 14:58:18.025579 14850 tablet_bootstrap.cc:492] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: No bootstrap required, opened a new log
I20260811 14:58:18.025797 14850 ts_tablet_manager.cc:1397] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 14:58:18.028568 14848 raft_consensus.cc:348] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.028847 14848 raft_consensus.cc:374] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.028908 14848 raft_consensus.cc:729] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4131592b51df482388d8f8fd9b2461e4, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.029012 14847 raft_consensus.cc:348] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.029296 14847 raft_consensus.cc:374] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.029351 14847 raft_consensus.cc:729] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6b3ca7f9744a4d8efa59c824ba527f, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.029397 14848 consensus_queue.cc:260] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.029512 14850 raft_consensus.cc:348] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.029829 14850 raft_consensus.cc:374] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.029771 14847 consensus_queue.cc:260] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.029902 14850 raft_consensus.cc:729] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2cbe593a0b4d44a150959a1cde14ab, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.030344 14571 heartbeater.cc:503] Master 127.11.225.126:37251 was elected leader, sending a full tablet report...
I20260811 14:58:18.030488 14848 ts_tablet_manager.cc:1428] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 14:58:18.030603 14847 ts_tablet_manager.cc:1428] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 14:58:18.030956 14330 heartbeater.cc:503] Master 127.11.225.126:37251 was elected leader, sending a full tablet report...
I20260811 14:58:18.031664 14850 consensus_queue.cc:260] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.032387 14808 heartbeater.cc:503] Master 127.11.225.126:37251 was elected leader, sending a full tablet report...
I20260811 14:58:18.032795 14850 ts_tablet_manager.cc:1428] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260811 14:58:18.072762 14572 tablet.cc:2369] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:18.103287 14331 tablet.cc:2369] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:18.145900 14863 raft_consensus.cc:482] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:18.146188 14863 raft_consensus.cc:504] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.147564 14863 leader_election.cc:288] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903), 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885)
I20260811 14:58:18.151989 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.147862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41903 (local address 127.11.225.67:35877)
0811 14:58:18.148076 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.148093 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.148206 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.148535 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.148538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.148556 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.148684 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.148694 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.149860 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.149864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.150717 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.150727 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.151536 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.151539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.151631 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.151706 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.151808 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.151873 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 14:58:18.152089 14838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.147934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:35877 (local address 127.11.225.65:41903)
0811 14:58:18.148077 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.148084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.148148 (+ 64us) server_negotiation.cc:407] Connection header received
0811 14:58:18.148375 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.148378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.148427 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.148499 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.148968 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.149725 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.150898 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.151374 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.151523 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.151591 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.151858 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.151948 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 14:58:18.152809 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.147933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38885 (local address 127.11.225.67:39993)
0811 14:58:18.148340 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.148351 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.148473 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.148865 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.148867 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.148881 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.149708 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.149720 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.150469 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.150471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.151291 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.151300 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.152419 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.152426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.152548 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.152569 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.152639 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.152695 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":159,"threads_started":1}
I20260811 14:58:18.152899 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.147993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:39993 (local address 127.11.225.66:38885)
0811 14:58:18.148160 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.148165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.148430 (+ 265us) server_negotiation.cc:407] Connection header received
0811 14:58:18.148611 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.148615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.148668 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.148716 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.149876 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.150351 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.151466 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.152141 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.152278 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.152332 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.152689 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.152769 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 14:58:18.152804 14253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eb89051021f48dbbbcfa33f20fe7020" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" is_pre_election: true
I20260811 14:58:18.153160 14253 raft_consensus.cc:2454] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 0.
I20260811 14:58:18.153568 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eb89051021f48dbbbcfa33f20fe7020" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4" is_pre_election: true
I20260811 14:58:18.153648 14619 leader_election.cc:302] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6b3ca7f9744a4d8efa59c824ba527f, cd2cbe593a0b4d44a150959a1cde14ab; no voters:
I20260811 14:58:18.153884 14484 raft_consensus.cc:2454] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 0.
I20260811 14:58:18.153945 14863 raft_consensus.cc:2781] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:18.154037 14863 raft_consensus.cc:482] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:18.154090 14863 raft_consensus.cc:3037] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.155164 14863 raft_consensus.cc:504] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.155588 14863 leader_election.cc:288] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 election: Requested vote from peers 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903), 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885)
I20260811 14:58:18.155946 14253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eb89051021f48dbbbcfa33f20fe7020" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f"
I20260811 14:58:18.156025 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4eb89051021f48dbbbcfa33f20fe7020" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4"
I20260811 14:58:18.156111 14253 raft_consensus.cc:3037] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.156191 14484 raft_consensus.cc:3037] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.157363 14253 raft_consensus.cc:2454] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 1.
I20260811 14:58:18.157436 14484 raft_consensus.cc:2454] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 1.
I20260811 14:58:18.157815 14615 leader_election.cc:302] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4131592b51df482388d8f8fd9b2461e4, cd2cbe593a0b4d44a150959a1cde14ab; no voters:
I20260811 14:58:18.158047 14863 raft_consensus.cc:2781] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:18.158241 14863 raft_consensus.cc:686] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 LEADER]: Becoming Leader. State: Replica: cd2cbe593a0b4d44a150959a1cde14ab, State: Running, Role: LEADER
I20260811 14:58:18.158566 14863 consensus_queue.cc:237] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.162124 13995 catalog_manager.cc:5495] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab reported cstate change: term changed from 0 to 1, leader changed from <none> to cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67). New cstate: current_term: 1 leader_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } health_report { overall_health: HEALTHY } } }
W20260811 14:58:18.198508 14810 tablet.cc:2369] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:18.202478 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.198848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49032 (local address 127.11.225.67:44099)
0811 14:58:18.198996 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.199001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.199019 (+ 18us) server_negotiation.cc:407] Connection header received
0811 14:58:18.199243 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.199245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.199301 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.199388 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:18.199653 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.200173 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.201085 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.201308 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.201388 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.201687 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.202147 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.202235 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.202323 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.202373 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:58:18.208814 14484 raft_consensus.cc:1261] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Refusing update from remote peer cd2cbe593a0b4d44a150959a1cde14ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.209585 14863 consensus_queue.cc:1035] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.210888 14253 raft_consensus.cc:1261] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Refusing update from remote peer cd2cbe593a0b4d44a150959a1cde14ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.211623 14863 consensus_queue.cc:1035] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.232517 13996 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:18.232823 13996 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:18.235873 13996 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Sending DeleteTablet for 3 replicas of tablet 4eb89051021f48dbbbcfa33f20fe7020
I20260811 14:58:18.236919 14450 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:52326
I20260811 14:58:18.236915 14222 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:36774
I20260811 14:58:18.237835 14695 tablet_service.cc:1514] Processing DeleteTablet for tablet 4eb89051021f48dbbbcfa33f20fe7020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49016
I20260811 14:58:18.237919 14889 tablet_replica.cc:330] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: stopping tablet replica
I20260811 14:58:18.237870 13996 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 14:58:18.238288 14889 raft_consensus.cc:2229] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:18.238348 14893 tablet_replica.cc:330] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: stopping tablet replica
I20260811 14:58:18.238638 14893 raft_consensus.cc:2229] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:18.238636 14889 raft_consensus.cc:2258] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 14:58:18.238782 13996 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:18.239041 14893 raft_consensus.cc:2258] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:18.239084 14892 tablet_replica.cc:330] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: stopping tablet replica
I20260811 14:58:18.239423 14892 raft_consensus.cc:2229] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:18.239738 14892 raft_consensus.cc:2258] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:18.240638 14893 ts_tablet_manager.cc:1905] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.241343 14889 ts_tablet_manager.cc:1905] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.243558 14893 ts_tablet_manager.cc:1918] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:18.243659 14893 log.cc:1196] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/4eb89051021f48dbbbcfa33f20fe7020
I20260811 14:58:18.243999 14893 ts_tablet_manager.cc:1939] T 4eb89051021f48dbbbcfa33f20fe7020 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting consensus metadata
I20260811 14:58:18.244256 14889 ts_tablet_manager.cc:1918] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:18.244360 14889 log.cc:1196] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/4eb89051021f48dbbbcfa33f20fe7020
I20260811 14:58:18.244710 14889 ts_tablet_manager.cc:1939] T 4eb89051021f48dbbbcfa33f20fe7020 P 4131592b51df482388d8f8fd9b2461e4: Deleting consensus metadata
I20260811 14:58:18.245159 13974 catalog_manager.cc:4841] TS cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67:44099): tablet 4eb89051021f48dbbbcfa33f20fe7020 (table test-table [id=9bfc9f7f9818450181718b353dc99651]) successfully deleted
I20260811 14:58:18.245414 14695 tablet_service.cc:1467] Processing CreateTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 (DEFAULT_TABLE table=test-table [id=0b5e51047eba48c38f971b238af94e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.245654 14695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61aea627fcb54a0e8ddd91200ef57f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.245765 14222 tablet_service.cc:1467] Processing CreateTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 (DEFAULT_TABLE table=test-table [id=0b5e51047eba48c38f971b238af94e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.246064 14222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61aea627fcb54a0e8ddd91200ef57f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.246327 13972 catalog_manager.cc:4841] TS 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885): tablet 4eb89051021f48dbbbcfa33f20fe7020 (table test-table [id=9bfc9f7f9818450181718b353dc99651]) successfully deleted
I20260811 14:58:18.247745 14850 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Bootstrap starting.
I20260811 14:58:18.248297 14450 tablet_service.cc:1467] Processing CreateTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 (DEFAULT_TABLE table=test-table [id=0b5e51047eba48c38f971b238af94e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:18.248554 14450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61aea627fcb54a0e8ddd91200ef57f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.248698 14850 tablet_bootstrap.cc:654] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.248721 14847 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Bootstrap starting.
I20260811 14:58:18.249795 14847 tablet_bootstrap.cc:654] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.250100 14850 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: No bootstrap required, opened a new log
I20260811 14:58:18.250174 14850 ts_tablet_manager.cc:1397] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:18.250492 14892 ts_tablet_manager.cc:1905] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.250649 14850 raft_consensus.cc:348] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.250752 14850 raft_consensus.cc:374] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.250785 14850 raft_consensus.cc:729] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2cbe593a0b4d44a150959a1cde14ab, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.250906 14850 consensus_queue.cc:260] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.250964 14848 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Bootstrap starting.
I20260811 14:58:18.251190 14850 ts_tablet_manager.cc:1428] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:18.252070 14848 tablet_bootstrap.cc:654] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.253388 14892 ts_tablet_manager.cc:1918] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:18.253436 14847 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: No bootstrap required, opened a new log
I20260811 14:58:18.253487 14892 log.cc:1196] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/4eb89051021f48dbbbcfa33f20fe7020
I20260811 14:58:18.253535 14847 ts_tablet_manager.cc:1397] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 14:58:18.253961 14848 tablet_bootstrap.cc:492] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: No bootstrap required, opened a new log
I20260811 14:58:18.254043 14848 ts_tablet_manager.cc:1397] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:18.254081 14847 raft_consensus.cc:348] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.254225 14847 raft_consensus.cc:374] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.254261 14847 raft_consensus.cc:729] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6b3ca7f9744a4d8efa59c824ba527f, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.254264 14892 ts_tablet_manager.cc:1939] T 4eb89051021f48dbbbcfa33f20fe7020 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting consensus metadata
I20260811 14:58:18.254415 14847 consensus_queue.cc:260] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.254577 14848 raft_consensus.cc:348] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.254684 14848 raft_consensus.cc:374] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.254729 14847 ts_tablet_manager.cc:1428] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:18.254724 14848 raft_consensus.cc:729] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4131592b51df482388d8f8fd9b2461e4, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.254870 14848 consensus_queue.cc:260] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.255160 14848 ts_tablet_manager.cc:1428] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:18.256811 13977 catalog_manager.cc:4841] TS 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903): tablet 4eb89051021f48dbbbcfa33f20fe7020 (table test-table [id=9bfc9f7f9818450181718b353dc99651]) successfully deleted
I20260811 14:58:18.307952 14867 raft_consensus.cc:482] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:18.308125 14867 raft_consensus.cc:504] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.308656 14867 leader_election.cc:288] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903), 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885)
I20260811 14:58:18.309106 14253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61aea627fcb54a0e8ddd91200ef57f79" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" is_pre_election: true
I20260811 14:58:18.309158 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61aea627fcb54a0e8ddd91200ef57f79" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4" is_pre_election: true
I20260811 14:58:18.309322 14253 raft_consensus.cc:2454] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 0.
I20260811 14:58:18.309383 14484 raft_consensus.cc:2454] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 0.
I20260811 14:58:18.309640 14619 leader_election.cc:302] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6b3ca7f9744a4d8efa59c824ba527f, cd2cbe593a0b4d44a150959a1cde14ab; no voters:
I20260811 14:58:18.309871 14867 raft_consensus.cc:2781] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:18.309962 14867 raft_consensus.cc:482] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:18.310006 14867 raft_consensus.cc:3037] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.311506 14867 raft_consensus.cc:504] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.311905 14867 leader_election.cc:288] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 election: Requested vote from peers 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903), 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885)
I20260811 14:58:18.312282 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61aea627fcb54a0e8ddd91200ef57f79" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4"
I20260811 14:58:18.312304 14253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61aea627fcb54a0e8ddd91200ef57f79" candidate_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f"
I20260811 14:58:18.312392 14484 raft_consensus.cc:3037] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.312431 14253 raft_consensus.cc:3037] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.313459 14484 raft_consensus.cc:2454] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 1.
I20260811 14:58:18.313648 14253 raft_consensus.cc:2454] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd2cbe593a0b4d44a150959a1cde14ab in term 1.
I20260811 14:58:18.313906 14615 leader_election.cc:302] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4131592b51df482388d8f8fd9b2461e4, cd2cbe593a0b4d44a150959a1cde14ab; no voters:
I20260811 14:58:18.314231 14867 raft_consensus.cc:2781] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:18.314424 14867 raft_consensus.cc:686] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 LEADER]: Becoming Leader. State: Replica: cd2cbe593a0b4d44a150959a1cde14ab, State: Running, Role: LEADER
I20260811 14:58:18.314587 14867 consensus_queue.cc:237] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.316506 13995 catalog_manager.cc:5495] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab reported cstate change: term changed from 0 to 1, leader changed from <none> to cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67). New cstate: current_term: 1 leader_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } health_report { overall_health: HEALTHY } } }
Aug 11 14:58:18 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:18.362746 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.351510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:37251 (local address 127.0.0.1:40686)
0811 14:58:18.351872 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.351887 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.352044 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.352422 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.352424 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.352910 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:18.353036 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.353045 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.354084 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.354087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.354917 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.354928 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.355637 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.355641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.355723 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.356429 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:18.356444 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:18.358546 (+ 2102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:18.360623 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:18.360635 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:18.360643 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:18.361002 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:18.361358 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:18.361362 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:18.361364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:18.361501 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:18.361978 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:18.361987 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:18.362141 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.362294 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.362510 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":131,"threads_started":1}
I20260811 14:58:18.362766 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.351544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40686 (local address 127.11.225.126:37251)
0811 14:58:18.351706 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.351711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.351958 (+ 247us) server_negotiation.cc:407] Connection header received
0811 14:58:18.352146 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.352149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.352184 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.352247 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:18.353160 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.353938 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.355053 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.355382 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.355450 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.358718 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:18.358722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:18.358725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:18.358751 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:18.360484 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.361128 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.361132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.361134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.361247 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.361618 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.361621 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.361623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.361842 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:18.361933 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.362356 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.362607 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":62}
I20260811 14:58:18.368361 13995 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:40686:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:58:18.369315 13995 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:18.375150 14222 tablet_service.cc:1467] Processing CreateTablet for tablet f243641f649a411d94529a3cc32c5718 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=038b0ee72fa0458188585fbd6696f9d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:18.375336 14695 tablet_service.cc:1467] Processing CreateTablet for tablet f243641f649a411d94529a3cc32c5718 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=038b0ee72fa0458188585fbd6696f9d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:18.375685 14222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243641f649a411d94529a3cc32c5718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.375763 14695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243641f649a411d94529a3cc32c5718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.378602 14850 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: Bootstrap starting.
I20260811 14:58:18.378988 14847 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: Bootstrap starting.
I20260811 14:58:18.379690 14450 tablet_service.cc:1467] Processing CreateTablet for tablet f243641f649a411d94529a3cc32c5718 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=038b0ee72fa0458188585fbd6696f9d1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:18.380023 14850 tablet_bootstrap.cc:654] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.380071 14847 tablet_bootstrap.cc:654] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.380098 14450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f243641f649a411d94529a3cc32c5718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:18.381371 14850 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: No bootstrap required, opened a new log
I20260811 14:58:18.381480 14850 ts_tablet_manager.cc:1397] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 14:58:18.381909 14850 raft_consensus.cc:348] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.382040 14850 raft_consensus.cc:374] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.382082 14850 raft_consensus.cc:729] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2cbe593a0b4d44a150959a1cde14ab, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.382226 14850 consensus_queue.cc:260] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.382537 14850 ts_tablet_manager.cc:1428] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:58:18.382587 14867 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.382745 14867 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.383559 14847 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: No bootstrap required, opened a new log
I20260811 14:58:18.383668 14847 ts_tablet_manager.cc:1397] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 14:58:18.384121 14847 raft_consensus.cc:348] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.384249 14847 raft_consensus.cc:374] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.384285 14847 raft_consensus.cc:729] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f6b3ca7f9744a4d8efa59c824ba527f, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.384402 14847 consensus_queue.cc:260] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.384703 14848 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: Bootstrap starting.
I20260811 14:58:18.384727 14847 ts_tablet_manager.cc:1428] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:18.384984 14859 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.385142 14859 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.385854 14848 tablet_bootstrap.cc:654] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:18.387465 14848 tablet_bootstrap.cc:492] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: No bootstrap required, opened a new log
I20260811 14:58:18.387598 14848 ts_tablet_manager.cc:1397] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 14:58:18.388099 14848 raft_consensus.cc:348] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.388257 14848 raft_consensus.cc:374] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:18.388307 14848 raft_consensus.cc:729] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4131592b51df482388d8f8fd9b2461e4, State: Initialized, Role: FOLLOWER
I20260811 14:58:18.388458 14848 consensus_queue.cc:260] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.388767 14857 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.388917 14857 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.389240 14848 ts_tablet_manager.cc:1428] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 14:58:18.630599 14859 raft_consensus.cc:482] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:18.630779 14859 raft_consensus.cc:504] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.632038 14859 leader_election.cc:288] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885), cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67:44099)
I20260811 14:58:18.636603 14841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.632445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:57671 (local address 127.11.225.66:38885)
0811 14:58:18.632667 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.632672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.632868 (+ 196us) server_negotiation.cc:407] Connection header received
0811 14:58:18.633196 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.633203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.633296 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.633384 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.633772 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.634355 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.635461 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.635910 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.636099 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.636162 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.636419 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.636496 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 14:58:18.636605 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.632304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38885 (local address 127.11.225.65:57671)
0811 14:58:18.632746 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.632762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.632901 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.633423 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.633425 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.633464 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.633608 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.633615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.634492 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.634495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.635347 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.635356 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.636092 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.636096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.636246 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.636270 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.636374 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.636445 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":2,"thread_start_us":136,"threads_started":1}
I20260811 14:58:18.636735 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.632385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:48639 (local address 127.11.225.67:44099)
0811 14:58:18.632641 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.632646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.632761 (+ 115us) server_negotiation.cc:407] Connection header received
0811 14:58:18.632938 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.632943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.633011 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.633094 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:18.633575 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.634141 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.635584 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.635984 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.636100 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.636160 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.636532 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.636601 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260811 14:58:18.636788 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.632280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:44099 (local address 127.11.225.65:48639)
0811 14:58:18.632600 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.632618 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.632791 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.633198 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.633201 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.633223 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:18.633389 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.633397 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.634258 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.634261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.635450 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.635461 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.636106 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.636110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.636342 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.636373 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.636518 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.636591 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":58,"thread_start_us":119,"threads_started":1}
I20260811 14:58:18.637287 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f243641f649a411d94529a3cc32c5718" candidate_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4" is_pre_election: true
I20260811 14:58:18.637310 14730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f243641f649a411d94529a3cc32c5718" candidate_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" is_pre_election: true
I20260811 14:58:18.637470 14484 raft_consensus.cc:2454] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f6b3ca7f9744a4d8efa59c824ba527f in term 0.
I20260811 14:58:18.637567 14730 raft_consensus.cc:2454] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f6b3ca7f9744a4d8efa59c824ba527f in term 0.
I20260811 14:58:18.637848 14134 leader_election.cc:302] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4131592b51df482388d8f8fd9b2461e4, 7f6b3ca7f9744a4d8efa59c824ba527f; no voters:
I20260811 14:58:18.638075 14859 raft_consensus.cc:2781] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:18.638165 14859 raft_consensus.cc:482] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:18.638224 14859 raft_consensus.cc:3037] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.639264 14859 raft_consensus.cc:504] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.639636 14859 leader_election.cc:288] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [CANDIDATE]: Term 1 election: Requested vote from peers 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885), cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67:44099)
I20260811 14:58:18.639966 14730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f243641f649a411d94529a3cc32c5718" candidate_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd2cbe593a0b4d44a150959a1cde14ab"
I20260811 14:58:18.639967 14484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f243641f649a411d94529a3cc32c5718" candidate_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4131592b51df482388d8f8fd9b2461e4"
I20260811 14:58:18.640069 14730 raft_consensus.cc:3037] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.640103 14484 raft_consensus.cc:3037] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:18.641017 14484 raft_consensus.cc:2454] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f6b3ca7f9744a4d8efa59c824ba527f in term 1.
I20260811 14:58:18.641058 14730 raft_consensus.cc:2454] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f6b3ca7f9744a4d8efa59c824ba527f in term 1.
I20260811 14:58:18.641366 14135 leader_election.cc:302] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f6b3ca7f9744a4d8efa59c824ba527f, cd2cbe593a0b4d44a150959a1cde14ab; no voters:
I20260811 14:58:18.641542 14859 raft_consensus.cc:2781] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:18.641826 14859 raft_consensus.cc:686] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 LEADER]: Becoming Leader. State: Replica: 7f6b3ca7f9744a4d8efa59c824ba527f, State: Running, Role: LEADER
I20260811 14:58:18.642091 14859 consensus_queue.cc:237] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } }
I20260811 14:58:18.643678 14919 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: TxnStatusTablet state changed. Reason: New leader 7f6b3ca7f9744a4d8efa59c824ba527f. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.643788 14919 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:18.644145 14923 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:58:18.644279 14923 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:58:18.644631 13995 catalog_manager.cc:5495] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65). New cstate: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:18.682722 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.678266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41903 (local address 127.0.0.1:36788)
0811 14:58:18.678439 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.678456 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.678585 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.679045 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.679047 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.679054 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:18.679174 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.679179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.680250 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.680252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.680857 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.680865 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.681479 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.681482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.681549 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.681603 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.682452 (+ 849us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.682466 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.682517 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.682599 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 14:58:18.682789 14927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.678445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36788 (local address 127.11.225.65:41903)
0811 14:58:18.678711 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.678716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.678731 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:18.678821 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.678824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.678892 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.679014 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:18.679301 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.680135 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.680974 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.681363 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.681461 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.681754 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.682355 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.682474 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.682540 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.682599 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":92,"threads_started":1}
I20260811 14:58:18.686146 14484 raft_consensus.cc:1261] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Refusing update from remote peer 7f6b3ca7f9744a4d8efa59c824ba527f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.686343 14730 raft_consensus.cc:1261] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Refusing update from remote peer 7f6b3ca7f9744a4d8efa59c824ba527f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.686681 14859 consensus_queue.cc:1035] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.686951 14919 consensus_queue.cc:1035] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.688650 14857 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: TxnStatusTablet state changed. Reason: New leader 7f6b3ca7f9744a4d8efa59c824ba527f. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.688787 14857 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.689491 14867 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: TxnStatusTablet state changed. Reason: New leader 7f6b3ca7f9744a4d8efa59c824ba527f. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.689626 14867 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.692420 14859 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.692553 14859 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:18.692706 14859 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.692788 14859 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 7f6b3ca7f9744a4d8efa59c824ba527f: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:18.693090 14857 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.693204 14857 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P 4131592b51df482388d8f8fd9b2461e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.693166 14872 mvcc.cc:205] Tried to move back new op lower bound from 7317341383412895744 to 7317341383240437760. Current Snapshot: MvccSnapshot[applied={T|T < 7317341383412895744}]
I20260811 14:58:18.693310 14867 tablet_replica.cc:439] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 } } peers { permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 } } peers { permanent_uuid: "cd2cbe593a0b4d44a150959a1cde14ab" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 44099 } } }
I20260811 14:58:18.693404 14867 tablet_replica.cc:442] T f243641f649a411d94529a3cc32c5718 P cd2cbe593a0b4d44a150959a1cde14ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:18.709613 14927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.706058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:57087 (local address 127.11.225.65:41903)
0811 14:58:18.706189 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.706193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.706318 (+ 125us) server_negotiation.cc:407] Connection header received
0811 14:58:18.706427 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.706431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.706482 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.706571 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:18.706776 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.707574 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.708407 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.708766 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.708862 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.709116 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.709199 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.709289 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.709447 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.709498 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:58:18.709664 14935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.705958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41903 (local address 127.11.225.67:57087)
0811 14:58:18.706233 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.706246 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.706340 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.706580 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.706583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.706589 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:18.706678 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.706683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.707684 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.707686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.708303 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.708311 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.708882 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.708884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.708946 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.708990 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.709337 (+ 347us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.709344 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.709413 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.709499 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":91,"threads_started":1}
I20260811 14:58:18.716657 14484 raft_consensus.cc:1261] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Refusing update from remote peer cd2cbe593a0b4d44a150959a1cde14ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.716684 14253 raft_consensus.cc:1261] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Refusing update from remote peer cd2cbe593a0b4d44a150959a1cde14ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:18.717087 14879 consensus_queue.cc:1035] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4131592b51df482388d8f8fd9b2461e4" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.717334 14867 consensus_queue.cc:1035] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f6b3ca7f9744a4d8efa59c824ba527f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:18.722424 14873 mvcc.cc:205] Tried to move back new op lower bound from 7317341383539589120 to 7317341381898072064. Current Snapshot: MvccSnapshot[applied={T|T < 7317341383539589120}]
I20260811 14:58:18.726178 14876 mvcc.cc:205] Tried to move back new op lower bound from 7317341383539589120 to 7317341381898072064. Current Snapshot: MvccSnapshot[applied={T|T < 7317341383539589120}]
I20260811 14:58:18.742048 14944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.737807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:44099 (local address 127.11.225.65:33659)
0811 14:58:18.738215 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:18.738228 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:18.738353 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:18.738616 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:18.738619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:18.738626 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:18.738738 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.738744 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.739778 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.739781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.740650 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:18.740663 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.741327 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.741331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:18.741406 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.741455 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.741784 (+ 329us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.741789 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:58:18.741841 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 14:58:18.741918 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":107,"threads_started":1}
I20260811 14:58:18.742056 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.737908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33659 (local address 127.11.225.67:44099)
0811 14:58:18.738034 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.738037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.738303 (+ 266us) server_negotiation.cc:407] Connection header received
0811 14:58:18.738462 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.738465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.738515 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.738602 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:18.738870 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.739660 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.740757 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.741082 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.741206 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.741610 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:18.741695 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:18.741770 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.741868 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.741923 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:58:18.769114 13996 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:18.769325 13996 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:18.771585 13996 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f2761140d0ce4173ad57676161a313a6: Sending DeleteTablet for 3 replicas of tablet 61aea627fcb54a0e8ddd91200ef57f79
I20260811 14:58:18.772233 14222 tablet_service.cc:1514] Processing DeleteTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:36774
I20260811 14:58:18.772349 14450 tablet_service.cc:1514] Processing DeleteTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:52326
I20260811 14:58:18.772396 14695 tablet_service.cc:1514] Processing DeleteTablet for tablet 61aea627fcb54a0e8ddd91200ef57f79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:18 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49016
I20260811 14:58:18.772605 14947 tablet_replica.cc:330] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: stopping tablet replica
I20260811 14:58:18.772754 14947 raft_consensus.cc:2229] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:18.772748 14948 tablet_replica.cc:330] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: stopping tablet replica
I20260811 14:58:18.772895 14947 raft_consensus.cc:2258] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:18.773110 14948 raft_consensus.cc:2229] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:18.773401 14948 raft_consensus.cc:2258] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:18.773730 14947 ts_tablet_manager.cc:1905] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.774407 14948 ts_tablet_manager.cc:1905] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.774684 14949 tablet_replica.cc:330] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: stopping tablet replica
I20260811 14:58:18.774817 14949 raft_consensus.cc:2229] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:18.775045 14949 raft_consensus.cc:2258] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:18.776176 14949 ts_tablet_manager.cc:1905] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:18.777279 14947 ts_tablet_manager.cc:1918] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:18.777364 14947 log.cc:1196] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/61aea627fcb54a0e8ddd91200ef57f79
I20260811 14:58:18.777678 14947 ts_tablet_manager.cc:1939] T 61aea627fcb54a0e8ddd91200ef57f79 P 7f6b3ca7f9744a4d8efa59c824ba527f: Deleting consensus metadata
I20260811 14:58:18.777994 14948 ts_tablet_manager.cc:1918] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:18.778139 14948 log.cc:1196] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/61aea627fcb54a0e8ddd91200ef57f79
I20260811 14:58:18.778489 14948 ts_tablet_manager.cc:1939] T 61aea627fcb54a0e8ddd91200ef57f79 P 4131592b51df482388d8f8fd9b2461e4: Deleting consensus metadata
I20260811 14:58:18.778465 13977 catalog_manager.cc:4841] TS 7f6b3ca7f9744a4d8efa59c824ba527f (127.11.225.65:41903): tablet 61aea627fcb54a0e8ddd91200ef57f79 (table test-table [id=0b5e51047eba48c38f971b238af94e5a]) successfully deleted
I20260811 14:58:18.779119 14949 ts_tablet_manager.cc:1918] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:18.779222 14949 log.cc:1196] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/61aea627fcb54a0e8ddd91200ef57f79
I20260811 14:58:18.779208 13972 catalog_manager.cc:4841] TS 4131592b51df482388d8f8fd9b2461e4 (127.11.225.66:38885): tablet 61aea627fcb54a0e8ddd91200ef57f79 (table test-table [id=0b5e51047eba48c38f971b238af94e5a]) successfully deleted
I20260811 14:58:18.779541 14949 ts_tablet_manager.cc:1939] T 61aea627fcb54a0e8ddd91200ef57f79 P cd2cbe593a0b4d44a150959a1cde14ab: Deleting consensus metadata
I20260811 14:58:18.780186 13974 catalog_manager.cc:4841] TS cd2cbe593a0b4d44a150959a1cde14ab (127.11.225.67:44099): tablet 61aea627fcb54a0e8ddd91200ef57f79 (table test-table [id=0b5e51047eba48c38f971b238af94e5a]) successfully deleted
Aug 11 14:58:18 dist-test-slave-8hhm krb5kdc[13924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460297, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:18.791846 14927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.774497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36796 (local address 127.11.225.65:41903)
0811 14:58:18.774613 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.774618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.781539 (+ 6921us) server_negotiation.cc:407] Connection header received
0811 14:58:18.781663 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.781665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.781710 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.781778 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:18.782664 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.783183 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.784318 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.784545 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.784619 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.787870 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:18.787885 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:18.787903 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:18.787954 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:18.789921 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.790397 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.790409 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.790410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.790514 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.790796 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.790800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.790802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.791108 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:18.791384 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.791513 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.791641 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 14:58:18.792465 14322 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36796
I20260811 14:58:18.802973 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:18.794405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40694 (local address 127.11.225.126:37251)
0811 14:58:18.794542 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:18.794545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:18.794740 (+ 195us) server_negotiation.cc:407] Connection header received
0811 14:58:18.794820 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:18.794823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:18.794881 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:18.794971 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:18.795658 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.796473 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.797351 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:18.797694 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:18.797804 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:18.799193 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:18.799197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:18.799200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:18.799229 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:18.800948 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.801566 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.801570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.801572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.801673 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:18.802020 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:18.802024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:18.802026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:18.802230 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:18.802383 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:18.802648 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 14:58:18.802777 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 14:58:18.803695 13996 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40694
I20260811 14:58:18.805032 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14105
I20260811 14:58:18.824014 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14341
I20260811 14:58:18.838922 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14588
I20260811 14:58:18.854514 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13944
2026-08-11T14:58:18Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3414 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:18 dist-test-slave-8hhm krb5kdc[14972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:18 dist-test-slave-8hhm krb5kdc[14972](info): set up 2 sockets
Aug 11 14:58:18 dist-test-slave-8hhm krb5kdc[14972](info): commencing operation
krb5kdc: starting...
W20260811 14:58:20.142666 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:20.274796 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35013
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:35013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:20.398962 14993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:20.399317 14993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:20.399394 14993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:20.403337 14993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:20.403419 14993 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:58:20.403453 14993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:20.403489 14993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:20.403523 14993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:20.403575 14993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:20.408733 14993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:35013
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:20.409790 14993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:20.410800 14993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:58:20.419579 14993 server_base.cc:1034] running on GCE node
W20260811 14:58:20.419575 15000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.419667 15004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.419662 15002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:20.420498 14993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:20.421676 14993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:20.422847 14993 hybrid_clock.cc:648] HybridClock initialized: now 1786460300422827 us; error 29 us; skew 500 ppm
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:20.430560 14993 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:20.431463 14993 webserver.cc:460] Webserver started at http://127.11.225.126:41327/ using document root <none> and password file <none>
I20260811 14:58:20.432040 14993 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:20.432102 14993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:20.432319 14993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:20.434407 14993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "1884394282f04b2292959245fa1e70bf"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "ffb6d4e86dffda3b3082e1f6e2ab9a05"
server_key_iv: "0497afd0db5c315577b58afd72076ed0"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.435003 14993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "1884394282f04b2292959245fa1e70bf"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "ffb6d4e86dffda3b3082e1f6e2ab9a05"
server_key_iv: "0497afd0db5c315577b58afd72076ed0"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.438763 14993 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:20.441162 15016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:20.442566 14993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:20.442724 14993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "1884394282f04b2292959245fa1e70bf"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "ffb6d4e86dffda3b3082e1f6e2ab9a05"
server_key_iv: "0497afd0db5c315577b58afd72076ed0"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.442842 14993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:20.468662 14993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:20.472239 14993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:20.472446 14993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:20.480767 14993 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:35013
I20260811 14:58:20.480791 15123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:35013 every 8 connection(s)
I20260811 14:58:20.481796 14993 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:20.484543 15124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:20.489841 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Bootstrap starting.
I20260811 14:58:20.492043 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14993
I20260811 14:58:20.492182 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:20.492435 15124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:20.492460 12165 external_mini_cluster.cc:1428] Setting key d59cfec247d5f0111aa8cbdcc881b02f
I20260811 14:58:20.493268 15124 log.cc:824] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:20.495597 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: No bootstrap required, opened a new log
I20260811 14:58:20.499874 15124 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } }
I20260811 14:58:20.500171 15124 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:20.500262 15124 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1884394282f04b2292959245fa1e70bf, State: Initialized, Role: FOLLOWER
I20260811 14:58:20.500716 15124 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } }
I20260811 14:58:20.500897 15124 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:20.500968 15124 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:20.501080 15124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:20.502066 15124 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } }
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:20.502446 15124 leader_election.cc:302] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1884394282f04b2292959245fa1e70bf; no voters:
I20260811 14:58:20.502803 15124 leader_election.cc:288] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:20.502964 15132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:20.503261 15132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [term 1 LEADER]: Becoming Leader. State: Replica: 1884394282f04b2292959245fa1e70bf, State: Running, Role: LEADER
I20260811 14:58:20.503648 15132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } }
I20260811 14:58:20.504202 15124 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:20.504904 15132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1884394282f04b2292959245fa1e70bf. Latest consensus state: current_term: 1 leader_uuid: "1884394282f04b2292959245fa1e70bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } } }
I20260811 14:58:20.505044 15132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:20.505539 15135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1884394282f04b2292959245fa1e70bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1884394282f04b2292959245fa1e70bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35013 } } }
I20260811 14:58:20.505710 15135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:20.508572 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:20.493667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57046 (local address 127.11.225.126:35013)
0811 14:58:20.494124 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:20.494144 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:20.494189 (+ 45us) server_negotiation.cc:407] Connection header received
0811 14:58:20.495025 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:20.495049 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:20.495435 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:20.495833 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:20.496583 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.498211 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.499109 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.499828 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.500004 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:20.503095 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:20.503101 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:20.503117 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:20.503146 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:20.505426 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.505989 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.505995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.506003 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.506164 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.506544 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.506549 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.506551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.507113 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:20.507335 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:20.507636 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 14:58:20.507893 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":131,"threads_started":1}
W20260811 14:58:20.510061 15157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:58:20.510146 15157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:58:20.510217 15141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:20.510950 15141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:20.516798 15141 catalog_manager.cc:1347] Generated new cluster ID: e9a14dc4d25549429e02177b4cb1d657
I20260811 14:58:20.516872 15141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:20.533078 15141 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:20.534052 15141 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:20.539346 15141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Generated new TSK 0
I20260811 14:58:20.539981 15141 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:20.574627 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35013
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:20.713609 15165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:20.713892 15165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:20.713977 15165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:20.717962 15165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:20.718050 15165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:20.718118 15165 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:58:20.718160 15165 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:20.718219 15165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:20.723665 15165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:35013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:20.724774 15165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:20.726120 15165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:20.736191 15174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.736159 15175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.736181 15177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:20.736364 15165 server_base.cc:1034] running on GCE node
I20260811 14:58:20.736847 15165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:20.737648 15165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:20.738852 15165 hybrid_clock.cc:648] HybridClock initialized: now 1786460300738831 us; error 33 us; skew 500 ppm
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:20.741746 15165 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:20.742607 15165 webserver.cc:460] Webserver started at http://127.11.225.65:33457/ using document root <none> and password file <none>
I20260811 14:58:20.743160 15165 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:20.743217 15165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:20.743376 15165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:20.745441 15165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "68290a1382d84a4b8b756dcdd368b42e"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7a3032984157f69ad31c8ac2563b969f"
server_key_iv: "b6e744538f9bfd41b3e1718e5b4adab2"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.746368 15165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "68290a1382d84a4b8b756dcdd368b42e"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7a3032984157f69ad31c8ac2563b969f"
server_key_iv: "b6e744538f9bfd41b3e1718e5b4adab2"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.750628 15165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:58:20.753331 15186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:20.754586 15165 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:20.754691 15165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "68290a1382d84a4b8b756dcdd368b42e"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7a3032984157f69ad31c8ac2563b969f"
server_key_iv: "b6e744538f9bfd41b3e1718e5b4adab2"
server_key_version: "encryptionkey@0"
I20260811 14:58:20.754786 15165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:20.785015 15165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:20.788719 15165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:20.788889 15165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:20.790402 15165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:20.790498 15165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:20.790581 15165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:20.790628 15165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:20.802722 15165 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:34633
I20260811 14:58:20.803658 15388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:34633 every 8 connection(s)
I20260811 14:58:20.803911 15165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:20.806042 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:20.791405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36001 (local address 127.11.225.126:35013)
0811 14:58:20.791548 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:20.791555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:20.792702 (+ 1147us) server_negotiation.cc:407] Connection header received
0811 14:58:20.793934 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:20.793939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:20.794011 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:20.794116 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:20.795709 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.796626 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.798038 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.798424 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.798547 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:20.801714 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:20.801718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:20.801720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:20.801751 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:20.803526 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.804247 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.804254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.804259 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.804366 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.804812 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.804817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.804819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.805036 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:20.805149 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:20.805729 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 14:58:20.805858 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:58:20.806845 15207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:20.792014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.65:36001)
0811 14:58:20.792545 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:20.792590 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:20.793618 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:20.794341 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:20.794352 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:20.794837 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:20.795536 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:20.795553 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.796788 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.796791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:20.797909 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:20.797919 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.798617 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.798621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:20.798798 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:20.799438 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:20.799459 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:20.801525 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:20.803662 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:20.803667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:20.803679 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:20.804124 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:20.804505 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:20.804509 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:20.804511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:20.804717 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:20.805147 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:20.805154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:20.805427 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 14:58:20.805668 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 14:58:20.806005 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":161,"threads_started":1}
I20260811 14:58:20.808223 15389 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35013
I20260811 14:58:20.808364 15389 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:20.808917 15389 heartbeater.cc:511] Master 127.11.225.126:35013 requested a full tablet report, sending...
I20260811 14:58:20.810678 15043 ts_manager.cc:194] Registered new tserver with Master: 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633)
I20260811 14:58:20.812139 15043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:36001
I20260811 14:58:20.812711 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15165
I20260811 14:58:20.812850 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:20.813233 12165 external_mini_cluster.cc:1428] Setting key 501a18b26b7ddcb0f936a0e87c11bcb5
I20260811 14:58:20.818150 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:20.810664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:35633 (local address 127.11.225.126:35013)
0811 14:58:20.810791 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:20.810795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:20.811024 (+ 229us) server_negotiation.cc:407] Connection header received
0811 14:58:20.811113 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:20.811115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:20.811152 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:20.811246 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:20.811760 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.812317 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.813444 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.813736 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.813853 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:20.815099 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:20.815103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:20.815106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:20.815129 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:20.816467 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.816893 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.816896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.816898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.816986 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:20.817342 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:20.817345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:20.817347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:20.817519 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:20.817628 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:20.817884 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 14:58:20.818005 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:58:20.818186 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:20.810606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.65:35633)
0811 14:58:20.810910 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:20.810923 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:20.811025 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:20.811292 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:20.811295 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:20.811500 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:20.811636 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:20.811643 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.812440 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.812444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:20.813330 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:20.813343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:20.813869 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:20.813872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:20.813977 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:20.814537 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:20.814553 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:20.814970 (+ 417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:20.816581 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:20.816584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:20.816586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:20.816775 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:20.817090 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:20.817093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:20.817095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:20.817184 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:20.817619 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:20.817622 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:20.817721 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 14:58:20.817830 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 14:58:20.817966 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:20.845705 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35013
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:20.973912 15404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:20.974174 15404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:20.974220 15404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:20.978286 15404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:20.978341 15404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:20.978392 15404 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:58:20.978440 15404 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:20.978500 15404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:20.983804 15404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:35013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:20.984869 15404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:20.985932 15404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:20.995854 15411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.995858 15415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:20.995872 15412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:20.996100 15404 server_base.cc:1034] running on GCE node
I20260811 14:58:20.996595 15404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:20.997161 15404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:20.998368 15404 hybrid_clock.cc:648] HybridClock initialized: now 1786460300998354 us; error 23 us; skew 500 ppm
Aug 11 14:58:20 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:21.001073 15404 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:21.001986 15404 webserver.cc:460] Webserver started at http://127.11.225.66:38347/ using document root <none> and password file <none>
I20260811 14:58:21.002480 15404 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:21.002545 15404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:21.002727 15404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:21.004801 15404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "c5e6529d233c4db3b5b80d54c55b9843"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7962fa836d1d6e971b51947e2a2513d0"
server_key_iv: "cb33d4627ed781147b0ac0916d4a211c"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.005604 15404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "c5e6529d233c4db3b5b80d54c55b9843"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7962fa836d1d6e971b51947e2a2513d0"
server_key_iv: "cb33d4627ed781147b0ac0916d4a211c"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.009516 15404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 14:58:21.011866 15432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:21.013079 15404 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:21.013173 15404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c5e6529d233c4db3b5b80d54c55b9843"
format_stamp: "Formatted at 2026-08-11 14:58:20 on dist-test-slave-8hhm"
server_key: "7962fa836d1d6e971b51947e2a2513d0"
server_key_iv: "cb33d4627ed781147b0ac0916d4a211c"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.013337 15404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:21.031006 15404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:21.033931 15404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:21.034096 15404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:21.035423 15404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:21.035473 15404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:21.035549 15404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:21.035583 15404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:21.047748 15404 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:34199
I20260811 14:58:21.047822 15616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:34199 every 8 connection(s)
I20260811 14:58:21.048820 15404 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:21.050930 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.036341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41559 (local address 127.11.225.126:35013)
0811 14:58:21.036468 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.036471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.037600 (+ 1129us) server_negotiation.cc:407] Connection header received
0811 14:58:21.038623 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.038628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.038697 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.038757 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.040568 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.041401 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.042716 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.042959 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.043090 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.047126 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.047130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.047133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.047164 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.048823 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.049443 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.049446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.049448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.049555 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.049929 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.049932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.049933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.050146 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.050231 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.050700 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.050808 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:58:21.051676 15446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.036876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.66:41559)
0811 14:58:21.037434 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.037474 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.038322 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.039240 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.039248 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.039778 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:21.040418 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.040447 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.041565 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.041568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.042582 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.042592 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.043146 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.043150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.043362 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.044025 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:21.044053 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:21.046948 (+ 2895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:21.048961 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.048967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.048984 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.049318 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.049667 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.049670 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.049672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.049833 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.050242 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:21.050247 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:21.050463 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.050620 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.050879 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":142,"threads_started":1}
I20260811 14:58:21.052871 15617 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35013
I20260811 14:58:21.053061 15617 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:21.053659 15617 heartbeater.cc:511] Master 127.11.225.126:35013 requested a full tablet report, sending...
I20260811 14:58:21.054378 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15404
I20260811 14:58:21.054487 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:21.054790 12165 external_mini_cluster.cc:1428] Setting key 5348d0a9473744bd317bbe54000f39fa
I20260811 14:58:21.054764 15043 ts_manager.cc:194] Registered new tserver with Master: c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199)
I20260811 14:58:21.055485 15043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:41559
I20260811 14:58:21.063170 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.055391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.66:49717)
0811 14:58:21.055660 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.055672 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.055782 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.056121 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.056124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.056331 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:21.056467 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.056473 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.057261 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.057264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.057898 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.057908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.058405 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.058412 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.058526 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.059124 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:21.059137 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:21.059463 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:21.061459 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.061463 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.061465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.061710 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.062068 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.062070 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.062071 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.062148 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.062719 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:21.062721 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:21.062799 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.062875 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.063022 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":2,"thread_start_us":107,"threads_started":1}
I20260811 14:58:21.063354 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.055767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49717 (local address 127.11.225.126:35013)
0811 14:58:21.055883 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.055889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.055904 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:21.055944 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.055946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.055990 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.056100 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.056596 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.057104 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.058028 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.058249 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.058386 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.059607 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.059613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.059618 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.059651 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.061338 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.061841 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.061848 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.061852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.061956 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.062243 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.062249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.062251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.062605 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.062725 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.062980 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.063116 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:21.084555 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35013
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:21.203205 15629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:21.203547 15629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:21.203667 15629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:21.208038 15629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:21.208108 15629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:21.208150 15629 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 14:58:21.208164 15629 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:21.208204 15629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:21.214138 15629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:35013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:21.215293 15629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:21.216323 15629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:21.226714 15638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:21.226747 15644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:21.226790 15636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:21.226950 15629 server_base.cc:1034] running on GCE node
I20260811 14:58:21.227514 15629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:21.228250 15629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:21.229409 15629 hybrid_clock.cc:648] HybridClock initialized: now 1786460301229387 us; error 32 us; skew 500 ppm
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460301, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:21.232358 15629 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:21.233421 15629 webserver.cc:460] Webserver started at http://127.11.225.67:37351/ using document root <none> and password file <none>
I20260811 14:58:21.234006 15629 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:21.234077 15629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:21.234344 15629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:21.236424 15629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "fc1d36de45554c4688b900c4dc9497d9"
format_stamp: "Formatted at 2026-08-11 14:58:21 on dist-test-slave-8hhm"
server_key: "7850ebfc4d43b24f71ad3ebe57dcee1c"
server_key_iv: "0769aa44abac62270f7abc20e4147738"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.236994 15629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "fc1d36de45554c4688b900c4dc9497d9"
format_stamp: "Formatted at 2026-08-11 14:58:21 on dist-test-slave-8hhm"
server_key: "7850ebfc4d43b24f71ad3ebe57dcee1c"
server_key_iv: "0769aa44abac62270f7abc20e4147738"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.240768 15629 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:21.243427 15654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:21.244657 15629 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:21.244794 15629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "fc1d36de45554c4688b900c4dc9497d9"
format_stamp: "Formatted at 2026-08-11 14:58:21 on dist-test-slave-8hhm"
server_key: "7850ebfc4d43b24f71ad3ebe57dcee1c"
server_key_iv: "0769aa44abac62270f7abc20e4147738"
server_key_version: "encryptionkey@0"
I20260811 14:58:21.244907 15629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:21.256112 15629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:21.259337 15629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:21.259543 15629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:21.261086 15629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:21.261137 15629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:21.261178 15629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:21.261230 15629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460301, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:21.274818 15629 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:35847
I20260811 14:58:21.274890 15846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:35847 every 8 connection(s)
I20260811 14:58:21.275753 15629 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:21.277369 15667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.262698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.67:43059)
0811 14:58:21.263276 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.263328 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.264568 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.265181 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.265192 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.265722 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:21.266376 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.266397 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.267629 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.267632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.268698 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.268708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.269332 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.269340 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.269597 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.270286 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:21.270305 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:21.272367 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:21.274470 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.274476 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.274489 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.274891 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.275201 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.275205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.275207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.275368 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.275787 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:21.275794 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:21.276064 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.276255 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.276600 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":167,"threads_started":1}
I20260811 14:58:21.277673 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.261807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:43059 (local address 127.11.225.126:35013)
0811 14:58:21.261972 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.261978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.263422 (+ 1444us) server_negotiation.cc:407] Connection header received
0811 14:58:21.264811 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.264817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.264878 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.264968 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.266551 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.267457 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.268833 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.269129 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.269276 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.272537 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.272541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.272543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.272571 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.274346 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.274990 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.274995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.274997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.275099 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.275470 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.275474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.275476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.275674 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.275789 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.277359 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.277510 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:58:21.278648 15849 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35013
I20260811 14:58:21.278786 15849 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:21.279331 15849 heartbeater.cc:511] Master 127.11.225.126:35013 requested a full tablet report, sending...
I20260811 14:58:21.280435 15044 ts_manager.cc:194] Registered new tserver with Master: fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.281121 15044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:43059
I20260811 14:58:21.281960 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15629
I20260811 14:58:21.282094 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:21.282411 12165 external_mini_cluster.cc:1428] Setting key 527ac1d6676998655b8714947df6c436
I20260811 14:58:21.284606 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:21.288727 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.281085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:47621 (local address 127.11.225.126:35013)
0811 14:58:21.281207 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.281233 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.281348 (+ 115us) server_negotiation.cc:407] Connection header received
0811 14:58:21.281490 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.281493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.281541 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.281616 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.282174 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.282750 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.283873 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.284085 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.284164 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.285371 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.285377 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.285381 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.285410 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.287049 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.287575 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.287577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.287579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.287653 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.287959 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.287961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.287962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.288146 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.288222 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.288531 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.288621 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:21.288900 15858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.280951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.11.225.67:47621)
0811 14:58:21.281280 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.281294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.281394 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.281658 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.281663 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.281876 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:21.282011 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.282017 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.282915 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.282918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.283754 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.283768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.284201 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.284205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.284309 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.284834 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:21.284846 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:21.285148 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:21.287164 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.287167 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.287168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.287467 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.287751 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.287756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.287760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.287866 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.288245 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:21.288249 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:21.288362 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.288480 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.288660 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:21.314560 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.305617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.11.225.126:35013)
0811 14:58:21.305775 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.305783 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.305797 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:21.305841 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.305844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.305886 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.305958 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.306663 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.307237 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.308148 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.308360 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.308442 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.311213 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.311216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.311218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.311245 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.312819 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.313338 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.313341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.313342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.313422 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.313687 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.313689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.313691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.313883 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.313986 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.314235 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.314356 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:21.317759 15044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:21.320950 15044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:21.335551 15877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.329485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:34633 (local address 127.0.0.1:49996)
0811 14:58:21.329904 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.329961 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.330090 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.331148 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.331154 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.331179 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.331323 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.331329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.332793 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.332796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.334017 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.334027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.334989 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.334993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.335112 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.335161 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.335274 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.335389 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":41,"thread_start_us":116,"threads_started":1}
I20260811 14:58:21.335598 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.329661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.11.225.65:34633)
0811 14:58:21.330029 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.330036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.330064 (+ 28us) server_negotiation.cc:407] Connection header received
0811 14:58:21.330299 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.330306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.330929 (+ 623us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.331129 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.331455 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.332657 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.334151 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.334862 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.334978 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.335145 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.335329 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.335451 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":57,"threads_started":1}
I20260811 14:58:21.335899 15881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.330307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34199 (local address 127.0.0.1:58904)
0811 14:58:21.330820 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.330837 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.330919 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.331674 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.331679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.331716 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.331824 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.331829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.332914 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.332919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.334361 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.334372 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.335470 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.335474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.335585 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.335611 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.335684 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.335764 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":65,"thread_start_us":94,"threads_started":1}
I20260811 14:58:21.336416 15880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.329888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35847 (local address 127.0.0.1:44778)
0811 14:58:21.330513 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.330529 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.330627 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.331517 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.331519 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.331536 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.331646 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.331656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.333348 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.333351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.334509 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.334522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.336130 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.336134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.336222 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.336240 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.336280 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.336327 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":110,"threads_started":1}
I20260811 14:58:21.336537 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.330753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58904 (local address 127.11.225.66:34199)
0811 14:58:21.331207 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.331220 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.331243 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:58:21.331318 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.331323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.331526 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.331943 (+ 417us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.332059 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.332791 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.334511 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.335327 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.336083 (+ 756us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.336246 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.336295 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.336380 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":103,"threads_started":1}
I20260811 14:58:21.337093 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.330464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44778 (local address 127.11.225.67:35847)
0811 14:58:21.331074 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.331087 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.331109 (+ 22us) server_negotiation.cc:407] Connection header received
0811 14:58:21.331184 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.331189 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.331366 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.331545 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.331755 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.332837 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.334810 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.335569 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.336723 (+ 1154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.336885 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.336926 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.336989 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":104,"threads_started":1}
I20260811 14:58:21.339020 15507 tablet_service.cc:1467] Processing CreateTablet for tablet cc6db1b2740c4e16b920734f619dc72d (DEFAULT_TABLE table=test-table [id=c0345724dded48eb88225e0d81f5ed62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.338894 15282 tablet_service.cc:1467] Processing CreateTablet for tablet cc6db1b2740c4e16b920734f619dc72d (DEFAULT_TABLE table=test-table [id=c0345724dded48eb88225e0d81f5ed62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.339316 15734 tablet_service.cc:1467] Processing CreateTablet for tablet cc6db1b2740c4e16b920734f619dc72d (DEFAULT_TABLE table=test-table [id=c0345724dded48eb88225e0d81f5ed62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.340093 15507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc6db1b2740c4e16b920734f619dc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.340093 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc6db1b2740c4e16b920734f619dc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.340309 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc6db1b2740c4e16b920734f619dc72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.347086 15885 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Bootstrap starting.
I20260811 14:58:21.348374 15887 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Bootstrap starting.
I20260811 14:58:21.349556 15889 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Bootstrap starting.
I20260811 14:58:21.350143 15885 tablet_bootstrap.cc:654] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.350497 15887 tablet_bootstrap.cc:654] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.350989 15885 log.cc:824] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:21.351363 15887 log.cc:824] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:21.351769 15889 tablet_bootstrap.cc:654] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.352635 15889 log.cc:824] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:21.353200 15885 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: No bootstrap required, opened a new log
I20260811 14:58:21.353430 15885 ts_tablet_manager.cc:1397] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260811 14:58:21.353755 15887 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: No bootstrap required, opened a new log
I20260811 14:58:21.353941 15887 ts_tablet_manager.cc:1397] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 14:58:21.354647 15889 tablet_bootstrap.cc:492] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: No bootstrap required, opened a new log
I20260811 14:58:21.354853 15889 ts_tablet_manager.cc:1397] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 14:58:21.357712 15889 raft_consensus.cc:348] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.357671 15885 raft_consensus.cc:348] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.357996 15885 raft_consensus.cc:374] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.357999 15889 raft_consensus.cc:374] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.358058 15885 raft_consensus.cc:729] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1d36de45554c4688b900c4dc9497d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.358057 15889 raft_consensus.cc:729] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.358590 15889 consensus_queue.cc:260] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.358512 15887 raft_consensus.cc:348] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.358515 15885 consensus_queue.cc:260] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.358752 15887 raft_consensus.cc:374] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.358812 15887 raft_consensus.cc:729] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.359215 15887 consensus_queue.cc:260] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.359606 15849 heartbeater.cc:503] Master 127.11.225.126:35013 was elected leader, sending a full tablet report...
I20260811 14:58:21.359706 15889 ts_tablet_manager.cc:1428] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 14:58:21.359699 15885 ts_tablet_manager.cc:1428] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 14:58:21.360006 15887 ts_tablet_manager.cc:1428] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:58:21.360051 15617 heartbeater.cc:503] Master 127.11.225.126:35013 was elected leader, sending a full tablet report...
I20260811 14:58:21.360303 15389 heartbeater.cc:503] Master 127.11.225.126:35013 was elected leader, sending a full tablet report...
I20260811 14:58:21.506760 15902 raft_consensus.cc:482] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:21.506999 15902 raft_consensus.cc:504] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.508332 15902 leader_election.cc:288] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.513804 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.508794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:59787 (local address 127.11.225.67:35847)
0811 14:58:21.508926 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.508937 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.509091 (+ 154us) server_negotiation.cc:407] Connection header received
0811 14:58:21.509266 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.509269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.509321 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.509405 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.509900 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.510689 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.512418 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.513020 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.513158 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.513211 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.513604 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.513676 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:58:21.513805 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.508714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:50841 (local address 127.11.225.66:34199)
0811 14:58:21.508841 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.508846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.509097 (+ 251us) server_negotiation.cc:407] Connection header received
0811 14:58:21.509266 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.509269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.509321 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.509405 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.509900 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.510679 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.512418 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.513020 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.513158 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.513211 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.513610 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.513679 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:58:21.513924 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.508548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34199 (local address 127.11.225.65:50841)
0811 14:58:21.508971 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.508986 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.509129 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.509435 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.509438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.509465 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.509762 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.509770 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.510797 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.510800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.512279 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.512293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.513161 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.513164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.513414 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.513489 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.513570 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.513724 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":360,"spinlock_wait_cycles":18048,"thread_start_us":131,"threads_started":1}
I20260811 14:58:21.513924 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.508625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35847 (local address 127.11.225.65:59787)
0811 14:58:21.508971 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.508986 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.509129 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.509435 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.509438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.509465 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.509762 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.509770 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.510797 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.510800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.512286 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.512293 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.513161 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.513164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.513418 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.513489 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.513570 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.513724 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":321,"spinlock_wait_cycles":27392,"thread_start_us":112,"threads_started":1}
I20260811 14:58:21.514559 15543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc6db1b2740c4e16b920734f619dc72d" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5e6529d233c4db3b5b80d54c55b9843" is_pre_election: true
I20260811 14:58:21.514755 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc6db1b2740c4e16b920734f619dc72d" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9" is_pre_election: true
I20260811 14:58:21.514864 15543 raft_consensus.cc:2454] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 0.
I20260811 14:58:21.515081 15776 raft_consensus.cc:2454] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 0.
I20260811 14:58:21.515412 15191 leader_election.cc:302] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843; no voters:
I20260811 14:58:21.515658 15902 raft_consensus.cc:2781] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:21.515756 15902 raft_consensus.cc:482] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:21.515817 15902 raft_consensus.cc:3037] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.516992 15902 raft_consensus.cc:504] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.517390 15902 leader_election.cc:288] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 election: Requested vote from peers c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.517738 15543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc6db1b2740c4e16b920734f619dc72d" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5e6529d233c4db3b5b80d54c55b9843"
I20260811 14:58:21.517755 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc6db1b2740c4e16b920734f619dc72d" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9"
I20260811 14:58:21.517853 15543 raft_consensus.cc:3037] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.517867 15776 raft_consensus.cc:3037] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.518779 15543 raft_consensus.cc:2454] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 1.
I20260811 14:58:21.518916 15776 raft_consensus.cc:2454] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 1.
I20260811 14:58:21.519166 15191 leader_election.cc:302] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843; no voters:
I20260811 14:58:21.519345 15902 raft_consensus.cc:2781] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:21.519570 15902 raft_consensus.cc:686] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 1 LEADER]: Becoming Leader. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Running, Role: LEADER
I20260811 14:58:21.519898 15902 consensus_queue.cc:237] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.523267 15044 catalog_manager.cc:5495] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e reported cstate change: term changed from 0 to 1, leader changed from <none> to 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65). New cstate: current_term: 1 leader_uuid: "68290a1382d84a4b8b756dcdd368b42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } health_report { overall_health: UNKNOWN } } }
W20260811 14:58:21.526975 15852 tablet.cc:2369] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:21.550195 15618 tablet.cc:2369] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:21.555414 15391 tablet.cc:2369] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 14:58:21 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460300, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:21.599821 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.590955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35013 (local address 127.0.0.1:45460)
0811 14:58:21.591293 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.591305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.591470 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.591751 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.591754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.592189 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:21.592279 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.592286 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.593066 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.593071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.593627 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.593635 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.594177 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.594180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.594259 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.594887 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:21.594900 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:21.596526 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:21.598289 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.598298 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.598303 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.598541 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.598826 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:21.598828 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:21.598829 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:21.598909 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:21.599328 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:21.599333 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:21.599442 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.599566 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.599685 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":82,"threads_started":1}
I20260811 14:58:21.599911 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.591030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.11.225.126:35013)
0811 14:58:21.591208 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.591214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.591412 (+ 198us) server_negotiation.cc:407] Connection header received
0811 14:58:21.591592 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.591594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.591631 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.591729 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:21.592409 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.592947 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.593760 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.594065 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.594173 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.596667 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:21.596670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:21.596672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:21.596696 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:21.598149 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.598646 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.598648 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.598650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.598735 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:21.599012 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:21.599014 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:21.599016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:21.599216 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:21.599300 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.599664 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.599768 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 14:58:21.604110 15044 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:45460:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:58:21.604977 15044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:21.609990 15282 tablet_service.cc:1467] Processing CreateTablet for tablet e72216ae7c03405883829bb2552a69b1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ff259e019c64cd5925fddbfb6304b05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:21.610085 15507 tablet_service.cc:1467] Processing CreateTablet for tablet e72216ae7c03405883829bb2552a69b1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ff259e019c64cd5925fddbfb6304b05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:21.610148 15734 tablet_service.cc:1467] Processing CreateTablet for tablet e72216ae7c03405883829bb2552a69b1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ff259e019c64cd5925fddbfb6304b05]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:21.610695 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e72216ae7c03405883829bb2552a69b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.610781 15507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e72216ae7c03405883829bb2552a69b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.610781 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e72216ae7c03405883829bb2552a69b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.613145 15887 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: Bootstrap starting.
I20260811 14:58:21.613638 15885 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: Bootstrap starting.
I20260811 14:58:21.613776 15889 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: Bootstrap starting.
I20260811 14:58:21.614463 15885 tablet_bootstrap.cc:654] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.614581 15887 tablet_bootstrap.cc:654] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.614756 15889 tablet_bootstrap.cc:654] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.615890 15887 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: No bootstrap required, opened a new log
I20260811 14:58:21.615909 15885 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: No bootstrap required, opened a new log
I20260811 14:58:21.615984 15885 ts_tablet_manager.cc:1397] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 14:58:21.615973 15887 ts_tablet_manager.cc:1397] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:21.616050 15889 tablet_bootstrap.cc:492] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: No bootstrap required, opened a new log
I20260811 14:58:21.616160 15889 ts_tablet_manager.cc:1397] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:21.616439 15887 raft_consensus.cc:348] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616448 15885 raft_consensus.cc:348] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616565 15887 raft_consensus.cc:374] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.616565 15885 raft_consensus.cc:374] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.616607 15885 raft_consensus.cc:729] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1d36de45554c4688b900c4dc9497d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.616607 15887 raft_consensus.cc:729] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.616585 15889 raft_consensus.cc:348] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616689 15889 raft_consensus.cc:374] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.616724 15889 raft_consensus.cc:729] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.616729 15885 consensus_queue.cc:260] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616735 15887 consensus_queue.cc:260] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616854 15889 consensus_queue.cc:260] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.616982 15885 ts_tablet_manager.cc:1428] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:21.617044 15887 ts_tablet_manager.cc:1428] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 14:58:21.617147 15889 ts_tablet_manager.cc:1428] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:21.617384 15898 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.617537 15898 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.617955 15901 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.618094 15901 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.618026 15902 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.618155 15902 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.653285 15898 raft_consensus.cc:482] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:21.653452 15898 raft_consensus.cc:504] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.654747 15898 leader_election.cc:288] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.659099 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.655072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41431 (local address 127.11.225.67:35847)
0811 14:58:21.655238 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.655244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.655423 (+ 179us) server_negotiation.cc:407] Connection header received
0811 14:58:21.655560 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.655562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.655600 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.655690 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.655984 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.656684 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.657882 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.658477 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.658570 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.658610 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.658897 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.658954 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 14:58:21.659129 15930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.654972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35847 (local address 127.11.225.66:41431)
0811 14:58:21.655291 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.655326 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.655470 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.655725 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.655728 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.655746 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.655860 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.655865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.656797 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.656801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.657769 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.657778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.658640 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.658644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.658762 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.658791 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.658880 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.658945 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
I20260811 14:58:21.659508 15929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.654936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:34633 (local address 127.11.225.66:46517)
0811 14:58:21.655236 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.655253 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.655365 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.655686 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.655689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.655705 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:21.656295 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.656305 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.657199 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.657202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.658213 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.658223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.659056 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.659060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.659168 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.659196 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.659312 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.659380 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
I20260811 14:58:21.659514 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.655043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:46517 (local address 127.11.225.65:34633)
0811 14:58:21.655171 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.655176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.655357 (+ 181us) server_negotiation.cc:407] Connection header received
0811 14:58:21.655508 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.655513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.655575 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.655640 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:21.656439 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.657059 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.658358 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.658938 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.659047 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.659091 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.659334 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.659411 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:58:21.659706 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e72216ae7c03405883829bb2552a69b1" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9" is_pre_election: true
I20260811 14:58:21.659849 15776 raft_consensus.cc:2454] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:21.660131 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e72216ae7c03405883829bb2552a69b1" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e" is_pre_election: true
I20260811 14:58:21.660295 15438 leader_election.cc:302] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5e6529d233c4db3b5b80d54c55b9843, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:21.660379 15314 raft_consensus.cc:2454] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:21.660616 15898 raft_consensus.cc:2781] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:21.660707 15898 raft_consensus.cc:482] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:21.660763 15898 raft_consensus.cc:3037] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.661813 15898 raft_consensus.cc:504] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.662186 15898 leader_election.cc:288] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Requested vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.662482 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e72216ae7c03405883829bb2552a69b1" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e"
I20260811 14:58:21.662540 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e72216ae7c03405883829bb2552a69b1" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9"
I20260811 14:58:21.662580 15314 raft_consensus.cc:3037] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.662667 15776 raft_consensus.cc:3037] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.663576 15314 raft_consensus.cc:2454] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:21.663600 15776 raft_consensus.cc:2454] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:21.663888 15438 leader_election.cc:302] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:21.664039 15898 raft_consensus.cc:2781] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:21.664294 15898 raft_consensus.cc:686] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 LEADER]: Becoming Leader. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Running, Role: LEADER
I20260811 14:58:21.664670 15898 consensus_queue.cc:237] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.666904 15931 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: TxnStatusTablet state changed. Reason: New leader c5e6529d233c4db3b5b80d54c55b9843. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.667027 15931 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:21.667454 15933 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:58:21.667659 15933 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:58:21.668056 15041 catalog_manager.cc:5495] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66). New cstate: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:21.686854 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.682764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34199 (local address 127.0.0.1:58918)
0811 14:58:21.682932 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.682950 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.683054 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.683426 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.683429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.683435 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:21.683534 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.683539 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.684490 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.684492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.685123 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.685131 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.685727 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.685729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.685807 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.685851 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.686598 (+ 747us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.686614 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.686674 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.686744 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 14:58:21.686919 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.683018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58918 (local address 127.11.225.66:34199)
0811 14:58:21.683159 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.683164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.683179 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:21.683245 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.683247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.683305 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.683408 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:21.683647 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.684390 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.685261 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.685614 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.685717 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.685987 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.686467 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.686605 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.686713 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.686768 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:21.692118 15314 raft_consensus.cc:1261] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.692260 15776 raft_consensus.cc:1261] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.692807 15931 consensus_queue.cc:1035] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:21.692986 15898 consensus_queue.cc:1035] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:21.696024 15902 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: TxnStatusTablet state changed. Reason: New leader c5e6529d233c4db3b5b80d54c55b9843. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.696139 15902 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.697050 15901 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: TxnStatusTablet state changed. Reason: New leader c5e6529d233c4db3b5b80d54c55b9843. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.697162 15901 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.701309 15898 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.701440 15898 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:21.701579 15898 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.701668 15898 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P c5e6529d233c4db3b5b80d54c55b9843: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:21.702108 15902 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.702219 15902 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P 68290a1382d84a4b8b756dcdd368b42e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.703441 15940 mvcc.cc:205] Tried to move back new op lower bound from 7317341395723595776 to 7317341395621023744. Current Snapshot: MvccSnapshot[applied={T|T < 7317341395723595776}]
I20260811 14:58:21.703613 15939 mvcc.cc:205] Tried to move back new op lower bound from 7317341395723595776 to 7317341395621023744. Current Snapshot: MvccSnapshot[applied={T|T < 7317341395723595776}]
I20260811 14:58:21.704279 15901 tablet_replica.cc:439] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } } }
I20260811 14:58:21.704386 15901 tablet_replica.cc:442] T e72216ae7c03405883829bb2552a69b1 P fc1d36de45554c4688b900c4dc9497d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:21.713325 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.709335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50004 (local address 127.11.225.65:34633)
0811 14:58:21.709449 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.709452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.709537 (+ 85us) server_negotiation.cc:407] Connection header received
0811 14:58:21.709700 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.709704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.709763 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.709868 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:21.710160 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.710935 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.711790 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.712148 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.712251 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.712481 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.712948 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.713059 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.713115 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.713167 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 14:58:21.724154 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.720688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53555 (local address 127.11.225.66:34199)
0811 14:58:21.720807 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.720811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.720961 (+ 150us) server_negotiation.cc:407] Connection header received
0811 14:58:21.721042 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.721044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.721086 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.721152 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:21.721441 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.721909 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.723147 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.723355 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.723438 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.723777 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.723841 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.723890 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.724011 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.724057 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:58:21.724228 15958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.720537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34199 (local address 127.11.225.65:53555)
0811 14:58:21.720844 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.720859 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.720964 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.721185 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.721188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.721195 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:21.721331 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.721338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.722012 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.722015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.723014 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.723027 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.723468 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.723472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.723573 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.723622 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.723919 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.723925 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.723991 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.724061 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":117,"threads_started":1}
I20260811 14:58:21.731432 15776 raft_consensus.cc:1261] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Refusing update from remote peer 68290a1382d84a4b8b756dcdd368b42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.731503 15543 raft_consensus.cc:1261] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Refusing update from remote peer 68290a1382d84a4b8b756dcdd368b42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.731974 15902 consensus_queue.cc:1035] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:21.732144 15907 consensus_queue.cc:1035] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:21.737236 15937 mvcc.cc:205] Tried to move back new op lower bound from 7317341395886817280 to 7317341395028094976. Current Snapshot: MvccSnapshot[applied={T|T < 7317341395886817280}]
I20260811 14:58:21.762053 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.757763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:51415 (local address 127.11.225.65:34633)
0811 14:58:21.757991 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:21.757996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:21.758203 (+ 207us) server_negotiation.cc:407] Connection header received
0811 14:58:21.758393 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:21.758397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:21.758446 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:21.758548 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:21.759086 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.759876 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.760752 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.761095 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.761257 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.761592 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.761673 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.761755 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:21.761845 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 14:58:21.761899 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260811 14:58:21.762106 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:21.757688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:34633 (local address 127.11.225.66:51415)
0811 14:58:21.758123 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:21.758139 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:21.758283 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:21.758697 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:21.758700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:21.758721 (+ 21us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:21.758901 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.758929 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.759985 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.759988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.760636 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:21.760645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:21.761258 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:21.761262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:21.761367 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:21.761437 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:21.761760 (+ 323us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:21.761769 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 14:58:21.761837 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 14:58:21.761916 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":96,"threads_started":1}
I20260811 14:58:21.789917 15044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:21.790122 15044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:21.792922 15044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Sending DeleteTablet for 3 replicas of tablet cc6db1b2740c4e16b920734f619dc72d
I20260811 14:58:21.793720 15507 tablet_service.cc:1514] Processing DeleteTablet for tablet cc6db1b2740c4e16b920734f619dc72d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:21 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:58904
I20260811 14:58:21.793880 15734 tablet_service.cc:1514] Processing DeleteTablet for tablet cc6db1b2740c4e16b920734f619dc72d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:21 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:44778
I20260811 14:58:21.794564 15977 tablet_replica.cc:330] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: stopping tablet replica
I20260811 14:58:21.794874 15977 raft_consensus.cc:2229] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:21.795099 15977 raft_consensus.cc:2258] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:21.795174 15282 tablet_service.cc:1514] Processing DeleteTablet for tablet cc6db1b2740c4e16b920734f619dc72d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:21 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49996
I20260811 14:58:21.795818 15044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:21.796218 15044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:21.796584 15977 ts_tablet_manager.cc:1905] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:21.798280 15975 tablet_replica.cc:330] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: stopping tablet replica
I20260811 14:58:21.798557 15979 tablet_replica.cc:330] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: stopping tablet replica
I20260811 14:58:21.798899 15975 raft_consensus.cc:2229] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:21.799227 15979 raft_consensus.cc:2229] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:21.799661 15979 raft_consensus.cc:2258] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:21.799937 15975 raft_consensus.cc:2258] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:21.802428 15979 ts_tablet_manager.cc:1905] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:21.803573 15282 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 (DEFAULT_TABLE table=test-table [id=23e417e61d3b4bfda1d8757ec4652b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.803829 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b7ed81d5bdc495198af24e5433805a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.805835 15734 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 (DEFAULT_TABLE table=test-table [id=23e417e61d3b4bfda1d8757ec4652b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.806092 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b7ed81d5bdc495198af24e5433805a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.806411 15507 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 (DEFAULT_TABLE table=test-table [id=23e417e61d3b4bfda1d8757ec4652b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:21.806481 15887 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Bootstrap starting.
I20260811 14:58:21.806674 15507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b7ed81d5bdc495198af24e5433805a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:21.807402 15887 tablet_bootstrap.cc:654] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.808519 15885 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Bootstrap starting.
I20260811 14:58:21.809270 15889 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Bootstrap starting.
I20260811 14:58:21.809653 15885 tablet_bootstrap.cc:654] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.810235 15889 tablet_bootstrap.cc:654] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:21.810786 15979 ts_tablet_manager.cc:1918] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:21.810885 15979 log.cc:1196] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/cc6db1b2740c4e16b920734f619dc72d
I20260811 14:58:21.811215 15979 ts_tablet_manager.cc:1939] T cc6db1b2740c4e16b920734f619dc72d P 68290a1382d84a4b8b756dcdd368b42e: Deleting consensus metadata
I20260811 14:58:21.812417 15018 catalog_manager.cc:4841] TS 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633): tablet cc6db1b2740c4e16b920734f619dc72d (table test-table [id=c0345724dded48eb88225e0d81f5ed62]) successfully deleted
I20260811 14:58:21.813324 15975 ts_tablet_manager.cc:1905] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:21.816955 15889 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: No bootstrap required, opened a new log
I20260811 14:58:21.817049 15889 ts_tablet_manager.cc:1397] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 14:58:21.817294 15977 ts_tablet_manager.cc:1918] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:21.817390 15977 log.cc:1196] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/cc6db1b2740c4e16b920734f619dc72d
I20260811 14:58:21.817622 15889 raft_consensus.cc:348] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.817734 15889 raft_consensus.cc:374] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.817735 15977 ts_tablet_manager.cc:1939] T cc6db1b2740c4e16b920734f619dc72d P fc1d36de45554c4688b900c4dc9497d9: Deleting consensus metadata
I20260811 14:58:21.817765 15889 raft_consensus.cc:729] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.817878 15889 consensus_queue.cc:260] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.818138 15889 ts_tablet_manager.cc:1428] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:21.818879 15021 catalog_manager.cc:4841] TS fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847): tablet cc6db1b2740c4e16b920734f619dc72d (table test-table [id=c0345724dded48eb88225e0d81f5ed62]) successfully deleted
I20260811 14:58:21.821910 15887 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: No bootstrap required, opened a new log
I20260811 14:58:21.822011 15887 ts_tablet_manager.cc:1397] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260811 14:58:21.822129 15975 ts_tablet_manager.cc:1918] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:21.822271 15975 log.cc:1196] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/cc6db1b2740c4e16b920734f619dc72d
I20260811 14:58:21.822409 15887 raft_consensus.cc:348] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.822538 15887 raft_consensus.cc:374] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.822567 15887 raft_consensus.cc:729] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.822674 15887 consensus_queue.cc:260] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.822889 15887 ts_tablet_manager.cc:1428] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:21.823634 15975 ts_tablet_manager.cc:1939] T cc6db1b2740c4e16b920734f619dc72d P c5e6529d233c4db3b5b80d54c55b9843: Deleting consensus metadata
I20260811 14:58:21.824765 15018 catalog_manager.cc:4841] TS c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199): tablet cc6db1b2740c4e16b920734f619dc72d (table test-table [id=c0345724dded48eb88225e0d81f5ed62]) successfully deleted
I20260811 14:58:21.826050 15885 tablet_bootstrap.cc:492] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: No bootstrap required, opened a new log
I20260811 14:58:21.826148 15885 ts_tablet_manager.cc:1397] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20260811 14:58:21.826573 15885 raft_consensus.cc:348] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.826689 15885 raft_consensus.cc:374] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:21.826719 15885 raft_consensus.cc:729] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1d36de45554c4688b900c4dc9497d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:21.826840 15885 consensus_queue.cc:260] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.827102 15885 ts_tablet_manager.cc:1428] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:21.879922 15907 raft_consensus.cc:482] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:21.880100 15907 raft_consensus.cc:504] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.881138 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b7ed81d5bdc495198af24e5433805a7" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9" is_pre_election: true
I20260811 14:58:21.881395 15776 raft_consensus.cc:2454] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 0.
I20260811 14:58:21.881924 15197 leader_election.cc:302] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:21.881140 15543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b7ed81d5bdc495198af24e5433805a7" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5e6529d233c4db3b5b80d54c55b9843" is_pre_election: true
I20260811 14:58:21.882143 15543 raft_consensus.cc:2454] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 0.
I20260811 14:58:21.882411 15969 raft_consensus.cc:2781] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:21.882474 15969 raft_consensus.cc:482] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:21.882525 15969 raft_consensus.cc:3037] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.880582 15907 leader_election.cc:288] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.883965 15969 raft_consensus.cc:504] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.884394 15969 leader_election.cc:288] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 election: Requested vote from peers c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:21.884800 15543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b7ed81d5bdc495198af24e5433805a7" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5e6529d233c4db3b5b80d54c55b9843"
I20260811 14:58:21.884933 15543 raft_consensus.cc:3037] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.884975 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b7ed81d5bdc495198af24e5433805a7" candidate_uuid: "68290a1382d84a4b8b756dcdd368b42e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9"
I20260811 14:58:21.885128 15776 raft_consensus.cc:3037] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:21.886112 15543 raft_consensus.cc:2454] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 1.
I20260811 14:58:21.886448 15191 leader_election.cc:302] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843; no voters:
I20260811 14:58:21.886562 15776 raft_consensus.cc:2454] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68290a1382d84a4b8b756dcdd368b42e in term 1.
I20260811 14:58:21.886669 15969 raft_consensus.cc:2781] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:21.886751 15969 raft_consensus.cc:686] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 1 LEADER]: Becoming Leader. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Running, Role: LEADER
I20260811 14:58:21.886880 15969 consensus_queue.cc:237] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:21.888684 15044 catalog_manager.cc:5495] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e reported cstate change: term changed from 0 to 1, leader changed from <none> to 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65). New cstate: current_term: 1 leader_uuid: "68290a1382d84a4b8b756dcdd368b42e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:21.930955 15776 raft_consensus.cc:1261] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Refusing update from remote peer 68290a1382d84a4b8b756dcdd368b42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.931032 15543 raft_consensus.cc:1261] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Refusing update from remote peer 68290a1382d84a4b8b756dcdd368b42e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:21.931394 15969 consensus_queue.cc:1035] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:21.931561 15907 consensus_queue.cc:1035] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:58:21.947149 15939 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 14:58:23.502930 15041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:23.503083 15041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:23.505826 15041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Sending DeleteTablet for 3 replicas of tablet 0b7ed81d5bdc495198af24e5433805a7
I20260811 14:58:23.506450 15507 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:58904
I20260811 14:58:23.506525 15282 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49996
I20260811 14:58:23.506831 16023 tablet_replica.cc:330] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: stopping tablet replica
I20260811 14:58:23.506816 15734 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7ed81d5bdc495198af24e5433805a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:44778
I20260811 14:58:23.507054 16023 raft_consensus.cc:2229] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:23.507501 16026 tablet_replica.cc:330] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: stopping tablet replica
I20260811 14:58:23.507675 16026 raft_consensus.cc:2229] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:23.507791 16026 raft_consensus.cc:2258] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.508028 16025 tablet_replica.cc:330] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: stopping tablet replica
I20260811 14:58:23.508172 16025 raft_consensus.cc:2229] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:23.508374 16025 raft_consensus.cc:2258] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.508669 16026 ts_tablet_manager.cc:1905] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.509101 16025 ts_tablet_manager.cc:1905] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.507217 16023 raft_consensus.cc:2258] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.509943 16023 ts_tablet_manager.cc:1905] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.511735 16025 ts_tablet_manager.cc:1918] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:58:23.511837 16025 log.cc:1196] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/0b7ed81d5bdc495198af24e5433805a7
I20260811 14:58:23.512063 16026 ts_tablet_manager.cc:1918] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:58:23.512146 16026 log.cc:1196] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/0b7ed81d5bdc495198af24e5433805a7
I20260811 14:58:23.512152 16025 ts_tablet_manager.cc:1939] T 0b7ed81d5bdc495198af24e5433805a7 P 68290a1382d84a4b8b756dcdd368b42e: Deleting consensus metadata
I20260811 14:58:23.512418 16026 ts_tablet_manager.cc:1939] T 0b7ed81d5bdc495198af24e5433805a7 P fc1d36de45554c4688b900c4dc9497d9: Deleting consensus metadata
I20260811 14:58:23.512837 16023 ts_tablet_manager.cc:1918] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:58:23.512924 16023 log.cc:1196] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/0b7ed81d5bdc495198af24e5433805a7
I20260811 14:58:23.512861 15018 catalog_manager.cc:4841] TS 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633): tablet 0b7ed81d5bdc495198af24e5433805a7 (table test-table [id=23e417e61d3b4bfda1d8757ec4652b40]) successfully deleted
I20260811 14:58:23.513115 15021 catalog_manager.cc:4841] TS fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847): tablet 0b7ed81d5bdc495198af24e5433805a7 (table test-table [id=23e417e61d3b4bfda1d8757ec4652b40]) successfully deleted
I20260811 14:58:23.513236 16023 ts_tablet_manager.cc:1939] T 0b7ed81d5bdc495198af24e5433805a7 P c5e6529d233c4db3b5b80d54c55b9843: Deleting consensus metadata
I20260811 14:58:23.513841 15018 catalog_manager.cc:4841] TS c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199): tablet 0b7ed81d5bdc495198af24e5433805a7 (table test-table [id=23e417e61d3b4bfda1d8757ec4652b40]) successfully deleted
Aug 11 14:58:23 dist-test-slave-8hhm krb5kdc[14972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460303, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:58:23 dist-test-slave-8hhm krb5kdc[14972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460303, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:23.538188 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:23.529661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45462 (local address 127.11.225.126:35013)
0811 14:58:23.529923 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:23.529929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:23.529944 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:23.530074 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:23.530076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:23.530119 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:23.530218 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:23.530927 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.531463 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.532303 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.532563 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.532658 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:23.535136 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:23.535139 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:23.535141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:23.535165 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:23.536596 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:23.537004 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:23.537008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:23.537010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:23.537114 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:23.537437 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:23.537439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:23.537440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:23.537617 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:23.537739 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:23.537938 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 14:58:23.538059 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":123,"threads_started":1}
I20260811 14:58:23.540925 15041 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:23.541469 15041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:23.546280 15507 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb00752e814bb5af3d6075af2025db (DEFAULT_TABLE table=test-table [id=6971baeddcc94b8786fce340ad183b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.546281 15282 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb00752e814bb5af3d6075af2025db (DEFAULT_TABLE table=test-table [id=6971baeddcc94b8786fce340ad183b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.546422 15734 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb00752e814bb5af3d6075af2025db (DEFAULT_TABLE table=test-table [id=6971baeddcc94b8786fce340ad183b40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.546608 15507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb00752e814bb5af3d6075af2025db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.546605 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb00752e814bb5af3d6075af2025db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.546746 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb00752e814bb5af3d6075af2025db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.549494 16047 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Bootstrap starting.
I20260811 14:58:23.549494 16048 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Bootstrap starting.
I20260811 14:58:23.550410 16047 tablet_bootstrap.cc:654] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.550403 16048 tablet_bootstrap.cc:654] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.550701 16049 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Bootstrap starting.
I20260811 14:58:23.551689 16049 tablet_bootstrap.cc:654] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.551744 16048 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: No bootstrap required, opened a new log
I20260811 14:58:23.551855 16048 ts_tablet_manager.cc:1397] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:23.552371 16048 raft_consensus.cc:348] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.552500 16048 raft_consensus.cc:374] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.552553 16048 raft_consensus.cc:729] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.552637 16047 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: No bootstrap required, opened a new log
I20260811 14:58:23.552770 16047 ts_tablet_manager.cc:1397] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:23.552702 16048 consensus_queue.cc:260] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.552945 16049 tablet_bootstrap.cc:492] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: No bootstrap required, opened a new log
I20260811 14:58:23.553038 16049 ts_tablet_manager.cc:1397] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:23.553100 16048 ts_tablet_manager.cc:1428] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 14:58:23.553328 16047 raft_consensus.cc:348] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.553468 16047 raft_consensus.cc:374] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.553519 16047 raft_consensus.cc:729] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1d36de45554c4688b900c4dc9497d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.553484 16049 raft_consensus.cc:348] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.553608 16049 raft_consensus.cc:374] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.553653 16049 raft_consensus.cc:729] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.553676 16047 consensus_queue.cc:260] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.553788 16049 consensus_queue.cc:260] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.554050 16049 ts_tablet_manager.cc:1428] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:58:23.554788 16047 ts_tablet_manager.cc:1428] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:23.717435 15998 raft_consensus.cc:482] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:23.717612 15998 raft_consensus.cc:504] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.718065 15998 leader_election.cc:288] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:23.718537 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb00752e814bb5af3d6075af2025db" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e" is_pre_election: true
I20260811 14:58:23.718561 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb00752e814bb5af3d6075af2025db" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9" is_pre_election: true
I20260811 14:58:23.718708 15314 raft_consensus.cc:2454] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:23.718721 15776 raft_consensus.cc:2454] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:23.719117 15438 leader_election.cc:302] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:23.719328 15998 raft_consensus.cc:2781] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:23.719398 15998 raft_consensus.cc:482] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:23.719448 15998 raft_consensus.cc:3037] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:23.720459 15998 raft_consensus.cc:504] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.720819 15998 leader_election.cc:288] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Requested vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:23.721203 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb00752e814bb5af3d6075af2025db" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e"
I20260811 14:58:23.721340 15314 raft_consensus.cc:3037] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:23.721342 15776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb00752e814bb5af3d6075af2025db" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9"
I20260811 14:58:23.721478 15776 raft_consensus.cc:3037] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:23.722334 15314 raft_consensus.cc:2454] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:23.722529 15776 raft_consensus.cc:2454] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:23.722628 15436 leader_election.cc:302] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68290a1382d84a4b8b756dcdd368b42e, c5e6529d233c4db3b5b80d54c55b9843; no voters:
I20260811 14:58:23.722810 15998 raft_consensus.cc:2781] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:23.722929 15998 raft_consensus.cc:686] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 1 LEADER]: Becoming Leader. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Running, Role: LEADER
I20260811 14:58:23.723114 15998 consensus_queue.cc:237] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.725194 15043 catalog_manager.cc:5495] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66). New cstate: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:23.745811 16061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:23.742280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.11.225.66:34199)
0811 14:58:23.742572 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:23.742585 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:23.742602 (+ 17us) server_negotiation.cc:407] Connection header received
0811 14:58:23.742654 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:23.742659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:23.742710 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:23.742806 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:23.743088 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.743656 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.744587 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.744842 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.744972 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:23.745272 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:23.745352 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:23.745442 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:23.745558 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 14:58:23.745616 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":101,"threads_started":1}
I20260811 14:58:23.755383 16061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:23.751762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49413 (local address 127.11.225.66:34199)
0811 14:58:23.751877 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:23.751880 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:23.752086 (+ 206us) server_negotiation.cc:407] Connection header received
0811 14:58:23.752188 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:23.752191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:23.752230 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:23.752309 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:23.752602 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.753354 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.754471 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.754686 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.754773 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:23.754997 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:23.755077 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:23.755135 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:23.755226 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 14:58:23.755268 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:23.755394 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:23.751637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34199 (local address 127.11.225.66:49413)
0811 14:58:23.752001 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:23.752015 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:23.752106 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:23.752378 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:23.752380 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:23.752388 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:23.752471 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:23.752475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.753477 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.753480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:23.754344 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:23.754354 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:23.754800 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:23.754802 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:23.754863 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:23.754888 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:23.755158 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:23.755163 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:58:23.755212 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:58:23.755275 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":129,"threads_started":1}
I20260811 14:58:23.760712 15776 raft_consensus.cc:1261] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:23.760877 15314 raft_consensus.cc:1261] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:23.761080 15993 consensus_queue.cc:1035] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:23.761412 15993 consensus_queue.cc:1035] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:23.795449 15043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:23.795598 15043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:23.797649 15043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Sending DeleteTablet for 3 replicas of tablet 86eb00752e814bb5af3d6075af2025db
I20260811 14:58:23.798285 15282 tablet_service.cc:1514] Processing DeleteTablet for tablet 86eb00752e814bb5af3d6075af2025db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49996
I20260811 14:58:23.798305 15734 tablet_service.cc:1514] Processing DeleteTablet for tablet 86eb00752e814bb5af3d6075af2025db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:44778
I20260811 14:58:23.798518 16026 tablet_replica.cc:330] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: stopping tablet replica
I20260811 14:58:23.798543 16025 tablet_replica.cc:330] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: stopping tablet replica
I20260811 14:58:23.798640 16026 raft_consensus.cc:2229] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:23.798686 16025 raft_consensus.cc:2229] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:23.798887 16025 raft_consensus.cc:2258] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.798755 16026 raft_consensus.cc:2258] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.799149 15043 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:23.799587 15043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:23.799724 16025 ts_tablet_manager.cc:1905] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.799968 16026 ts_tablet_manager.cc:1905] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.801996 15507 tablet_service.cc:1514] Processing DeleteTablet for tablet 86eb00752e814bb5af3d6075af2025db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:23 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:58904
I20260811 14:58:23.802218 16023 tablet_replica.cc:330] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: stopping tablet replica
I20260811 14:58:23.802368 16023 raft_consensus.cc:2229] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:23.802605 16025 ts_tablet_manager.cc:1918] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:23.802685 16025 log.cc:1196] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/86eb00752e814bb5af3d6075af2025db
I20260811 14:58:23.802736 16023 raft_consensus.cc:2258] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:23.802994 16025 ts_tablet_manager.cc:1939] T 86eb00752e814bb5af3d6075af2025db P 68290a1382d84a4b8b756dcdd368b42e: Deleting consensus metadata
I20260811 14:58:23.803911 15018 catalog_manager.cc:4841] TS 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633): tablet 86eb00752e814bb5af3d6075af2025db (table test-table [id=6971baeddcc94b8786fce340ad183b40]) successfully deleted
I20260811 14:58:23.804327 16026 ts_tablet_manager.cc:1918] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:23.804404 16026 log.cc:1196] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/86eb00752e814bb5af3d6075af2025db
I20260811 14:58:23.804649 16026 ts_tablet_manager.cc:1939] T 86eb00752e814bb5af3d6075af2025db P fc1d36de45554c4688b900c4dc9497d9: Deleting consensus metadata
I20260811 14:58:23.805441 15021 catalog_manager.cc:4841] TS fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847): tablet 86eb00752e814bb5af3d6075af2025db (table test-table [id=6971baeddcc94b8786fce340ad183b40]) successfully deleted
I20260811 14:58:23.805687 15734 tablet_service.cc:1467] Processing CreateTablet for tablet 48dc78337d12414ab99ae7d1828ac043 (DEFAULT_TABLE table=test-table [id=ca1ec5b40b844f5ab606f06533de4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.805946 15734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48dc78337d12414ab99ae7d1828ac043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.806578 15507 tablet_service.cc:1467] Processing CreateTablet for tablet 48dc78337d12414ab99ae7d1828ac043 (DEFAULT_TABLE table=test-table [id=ca1ec5b40b844f5ab606f06533de4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.806846 15507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48dc78337d12414ab99ae7d1828ac043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.808099 16047 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Bootstrap starting.
I20260811 14:58:23.809002 16047 tablet_bootstrap.cc:654] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.809405 16048 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Bootstrap starting.
I20260811 14:58:23.809814 15282 tablet_service.cc:1467] Processing CreateTablet for tablet 48dc78337d12414ab99ae7d1828ac043 (DEFAULT_TABLE table=test-table [id=ca1ec5b40b844f5ab606f06533de4588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:23.810036 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48dc78337d12414ab99ae7d1828ac043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:23.810268 16048 tablet_bootstrap.cc:654] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.812071 16049 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e: Bootstrap starting.
I20260811 14:58:23.812578 16023 ts_tablet_manager.cc:1905] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:23.812894 16049 tablet_bootstrap.cc:654] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:23.814350 16049 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e: No bootstrap required, opened a new log
I20260811 14:58:23.814447 16049 ts_tablet_manager.cc:1397] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:23.814849 16023 ts_tablet_manager.cc:1918] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:23.814926 16023 log.cc:1196] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/86eb00752e814bb5af3d6075af2025db
I20260811 14:58:23.814846 16049 raft_consensus.cc:348] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.814963 16049 raft_consensus.cc:374] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.815003 16049 raft_consensus.cc:729] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68290a1382d84a4b8b756dcdd368b42e, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.815183 16023 ts_tablet_manager.cc:1939] T 86eb00752e814bb5af3d6075af2025db P c5e6529d233c4db3b5b80d54c55b9843: Deleting consensus metadata
I20260811 14:58:23.815136 16049 consensus_queue.cc:260] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.815395 16049 ts_tablet_manager.cc:1428] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:23.815996 15018 catalog_manager.cc:4841] TS c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199): tablet 86eb00752e814bb5af3d6075af2025db (table test-table [id=6971baeddcc94b8786fce340ad183b40]) successfully deleted
I20260811 14:58:23.816039 16047 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: No bootstrap required, opened a new log
I20260811 14:58:23.816118 16047 ts_tablet_manager.cc:1397] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260811 14:58:23.816545 16047 raft_consensus.cc:348] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.816651 16047 raft_consensus.cc:374] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.816687 16047 raft_consensus.cc:729] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1d36de45554c4688b900c4dc9497d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.816789 16047 consensus_queue.cc:260] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.817029 16047 ts_tablet_manager.cc:1428] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:23.821996 16048 tablet_bootstrap.cc:492] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: No bootstrap required, opened a new log
I20260811 14:58:23.822100 16048 ts_tablet_manager.cc:1397] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260811 14:58:23.822486 16048 raft_consensus.cc:348] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.822618 16048 raft_consensus.cc:374] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:23.822647 16048 raft_consensus.cc:729] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Initialized, Role: FOLLOWER
I20260811 14:58:23.822763 16048 consensus_queue.cc:260] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:23.823006 16048 ts_tablet_manager.cc:1428] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:24.066519 15931 raft_consensus.cc:482] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:24.066702 15931 raft_consensus.cc:504] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:24.067200 15931 leader_election.cc:288] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:24.067730 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48dc78337d12414ab99ae7d1828ac043" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e" is_pre_election: true
I20260811 14:58:24.067770 15777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48dc78337d12414ab99ae7d1828ac043" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9" is_pre_election: true
I20260811 14:58:24.067936 15314 raft_consensus.cc:2454] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:24.067937 15777 raft_consensus.cc:2454] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 0.
I20260811 14:58:24.068310 15438 leader_election.cc:302] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5e6529d233c4db3b5b80d54c55b9843, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:24.068518 15931 raft_consensus.cc:2781] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:24.068588 15931 raft_consensus.cc:482] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:24.068635 15931 raft_consensus.cc:3037] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:24.069712 15931 raft_consensus.cc:504] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:24.070032 15931 leader_election.cc:288] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Requested vote from peers 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633), fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847)
I20260811 14:58:24.070369 15777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48dc78337d12414ab99ae7d1828ac043" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1d36de45554c4688b900c4dc9497d9"
I20260811 14:58:24.070394 15314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48dc78337d12414ab99ae7d1828ac043" candidate_uuid: "c5e6529d233c4db3b5b80d54c55b9843" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68290a1382d84a4b8b756dcdd368b42e"
I20260811 14:58:24.070482 15777 raft_consensus.cc:3037] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:24.070550 15314 raft_consensus.cc:3037] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:24.071537 15777 raft_consensus.cc:2454] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:24.071640 15314 raft_consensus.cc:2454] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5e6529d233c4db3b5b80d54c55b9843 in term 1.
I20260811 14:58:24.071905 15438 leader_election.cc:302] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5e6529d233c4db3b5b80d54c55b9843, fc1d36de45554c4688b900c4dc9497d9; no voters:
I20260811 14:58:24.072129 15931 raft_consensus.cc:2781] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:24.072248 15931 raft_consensus.cc:686] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 LEADER]: Becoming Leader. State: Replica: c5e6529d233c4db3b5b80d54c55b9843, State: Running, Role: LEADER
I20260811 14:58:24.072397 15931 consensus_queue.cc:237] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } }
I20260811 14:58:24.074090 15043 catalog_manager.cc:5495] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66). New cstate: current_term: 1 leader_uuid: "c5e6529d233c4db3b5b80d54c55b9843" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5e6529d233c4db3b5b80d54c55b9843" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:24.111124 15777 raft_consensus.cc:1261] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:24.111454 15314 raft_consensus.cc:1261] T 48dc78337d12414ab99ae7d1828ac043 P 68290a1382d84a4b8b756dcdd368b42e [term 1 FOLLOWER]: Refusing update from remote peer c5e6529d233c4db3b5b80d54c55b9843: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:24.111636 15993 consensus_queue.cc:1035] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1d36de45554c4688b900c4dc9497d9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:24.111841 15998 consensus_queue.cc:1035] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68290a1382d84a4b8b756dcdd368b42e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 34633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:58:24.125504 15991 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 14:58:25.676163 15040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:25.676316 15040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:25.678671 15040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1884394282f04b2292959245fa1e70bf: Sending DeleteTablet for 3 replicas of tablet 48dc78337d12414ab99ae7d1828ac043
I20260811 14:58:25.679471 15282 tablet_service.cc:1514] Processing DeleteTablet for tablet 48dc78337d12414ab99ae7d1828ac043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:25 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:49996
I20260811 14:58:25.679468 15506 tablet_service.cc:1514] Processing DeleteTablet for tablet 48dc78337d12414ab99ae7d1828ac043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:25 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:58904
I20260811 14:58:25.679541 15734 tablet_service.cc:1514] Processing DeleteTablet for tablet 48dc78337d12414ab99ae7d1828ac043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:25 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:44778
I20260811 14:58:25.679710 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15165
I20260811 14:58:25.706146 16114 tablet_replica.cc:330] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: stopping tablet replica
I20260811 14:58:25.706426 16114 raft_consensus.cc:2229] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:25.706549 16117 tablet_replica.cc:330] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: stopping tablet replica
I20260811 14:58:25.706722 16117 raft_consensus.cc:2229] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:25.706764 16114 raft_consensus.cc:2258] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:25.706862 16117 raft_consensus.cc:2258] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:25.707590 16114 ts_tablet_manager.cc:1905] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:25.707590 16117 ts_tablet_manager.cc:1905] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:25.710472 16117 ts_tablet_manager.cc:1918] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:58:25.710472 16114 ts_tablet_manager.cc:1918] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 14:58:25.710563 16117 log.cc:1196] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/48dc78337d12414ab99ae7d1828ac043
I20260811 14:58:25.710572 16114 log.cc:1196] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/48dc78337d12414ab99ae7d1828ac043
I20260811 14:58:25.710852 16117 ts_tablet_manager.cc:1939] T 48dc78337d12414ab99ae7d1828ac043 P fc1d36de45554c4688b900c4dc9497d9: Deleting consensus metadata
I20260811 14:58:25.710860 16114 ts_tablet_manager.cc:1939] T 48dc78337d12414ab99ae7d1828ac043 P c5e6529d233c4db3b5b80d54c55b9843: Deleting consensus metadata
I20260811 14:58:25.711676 15018 catalog_manager.cc:4841] TS c5e6529d233c4db3b5b80d54c55b9843 (127.11.225.66:34199): tablet 48dc78337d12414ab99ae7d1828ac043 (table test-table [id=ca1ec5b40b844f5ab606f06533de4588]) successfully deleted
I20260811 14:58:25.711733 15021 catalog_manager.cc:4841] TS fc1d36de45554c4688b900c4dc9497d9 (127.11.225.67:35847): tablet 48dc78337d12414ab99ae7d1828ac043 (table test-table [id=ca1ec5b40b844f5ab606f06533de4588]) successfully deleted
W20260811 14:58:25.716102 15018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:34633 (error 108)
I20260811 14:58:25.716352 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15404
I20260811 14:58:25.723371 16119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:25.719626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:34633 (local address 127.0.0.1:50012)
0811 14:58:25.723080 (+ 3454us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:25.723215 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:34633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3343,"thread_start_us":90,"threads_started":1}
W20260811 14:58:25.723562 15018 catalog_manager.cc:4584] TS 68290a1382d84a4b8b756dcdd368b42e (127.11.225.65:34633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 48dc78337d12414ab99ae7d1828ac043: Network error: Client connection negotiation failed: client connection to 127.11.225.65:34633: connect: Connection refused (error 111)
I20260811 14:58:25.730834 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15629
I20260811 14:58:25.746757 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14993
2026-08-11T14:58:25Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6888 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:25 dist-test-slave-8hhm krb5kdc[16128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:25 dist-test-slave-8hhm krb5kdc[16128](info): set up 2 sockets
Aug 11 14:58:25 dist-test-slave-8hhm krb5kdc[16128](info): commencing operation
krb5kdc: starting...
W20260811 14:58:27.055269 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:27.193608 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:34165
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:34165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:27.311659 16146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:27.311954 16146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:27.311996 16146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:27.316068 16146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:27.316130 16146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:27.316149 16146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:27.316166 16146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:27.316181 16146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:27.321668 16146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:34165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:34165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:27.322719 16146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:27.323695 16146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:27.332566 16152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:27.332573 16151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:27.332654 16146 server_base.cc:1034] running on GCE node
W20260811 14:58:27.332859 16156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:27.333473 16146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:27.334573 16146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:27.335736 16146 hybrid_clock.cc:648] HybridClock initialized: now 1786460307335704 us; error 45 us; skew 500 ppm
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:27.338598 16146 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:27.339481 16146 webserver.cc:460] Webserver started at http://127.11.225.126:35119/ using document root <none> and password file <none>
I20260811 14:58:27.340106 16146 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:27.340248 16146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:27.340489 16146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:27.342610 16146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "8e5aafa0d64a8fdfb3e9954b170b08eb"
server_key_iv: "23b8f48c85f6a14d332d9da6ca10b17a"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.343189 16146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "8e5aafa0d64a8fdfb3e9954b170b08eb"
server_key_iv: "23b8f48c85f6a14d332d9da6ca10b17a"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.347028 16146 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:27.349618 16171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.350898 16146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:58:27.351069 16146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "8e5aafa0d64a8fdfb3e9954b170b08eb"
server_key_iv: "23b8f48c85f6a14d332d9da6ca10b17a"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.351194 16146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:27.360720 16146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:27.363565 16146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:27.363755 16146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:27.371148 16146 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:34165
I20260811 14:58:27.371179 16249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:34165 every 8 connection(s)
I20260811 14:58:27.372098 16146 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:27.374945 16250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:27.380523 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16146
I20260811 14:58:27.380637 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:27.380708 16250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd: Bootstrap starting.
I20260811 14:58:27.380931 12165 external_mini_cluster.cc:1428] Setting key a470858afc60a5f599c3bf613d2122c1
I20260811 14:58:27.383358 16250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:27.384121 16250 log.cc:824] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:27.386036 16250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd: No bootstrap required, opened a new log
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:27.390321 16250 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } }
I20260811 14:58:27.390537 16250 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:27.390609 16250 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7eab9b9a0974ed2a05d1a5ffba311fd, State: Initialized, Role: FOLLOWER
I20260811 14:58:27.391076 16250 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } }
I20260811 14:58:27.391228 16250 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:27.391319 16250 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:27.391427 16250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:27.392352 16250 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } }
I20260811 14:58:27.392745 16250 leader_election.cc:302] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7eab9b9a0974ed2a05d1a5ffba311fd; no voters:
I20260811 14:58:27.393115 16250 leader_election.cc:288] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:27.393182 16257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:27.393452 16257 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [term 1 LEADER]: Becoming Leader. State: Replica: c7eab9b9a0974ed2a05d1a5ffba311fd, State: Running, Role: LEADER
I20260811 14:58:27.393812 16257 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } }
I20260811 14:58:27.394470 16250 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:27.395476 16261 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7eab9b9a0974ed2a05d1a5ffba311fd. Latest consensus state: current_term: 1 leader_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } } }
I20260811 14:58:27.395632 16261 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:27.395836 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:27.382357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42928 (local address 127.11.225.126:34165)
0811 14:58:27.382793 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:27.382808 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:27.382844 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:27.383526 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:27.383552 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:27.383870 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:27.384198 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:27.385010 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.386022 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.386883 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.387348 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.387542 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:27.390278 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:27.390283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:27.390295 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:27.390321 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:27.392175 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.392685 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.392689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.392694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.392804 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.393109 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.393115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.393117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.393695 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:27.393929 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:27.394517 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 14:58:27.394802 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":144,"threads_started":1}
I20260811 14:58:27.396370 16271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:27.397243 16258 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7eab9b9a0974ed2a05d1a5ffba311fd" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34165 } } }
I20260811 14:58:27.397373 16258 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:27.399937 16271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:27.405407 16271 catalog_manager.cc:1347] Generated new cluster ID: db1125bfbfc5415f8f2396c8473da833
I20260811 14:58:27.405498 16271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:27.418040 16271 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:27.419303 16271 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:27.425006 16271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7eab9b9a0974ed2a05d1a5ffba311fd: Generated new TSK 0
I20260811 14:58:27.425740 16271 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:27.466588 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:27.633327 16293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:27.633706 16293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:27.633802 16293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:27.643431 16293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:27.643527 16293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:27.643703 16293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:27.655871 16293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:27.657470 16293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:27.658942 16293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:27.671898 16304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:27.671913 16308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:27.672309 16293 server_base.cc:1034] running on GCE node
W20260811 14:58:27.672490 16306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:27.672916 16293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:27.673645 16293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:27.674854 16293 hybrid_clock.cc:648] HybridClock initialized: now 1786460307674830 us; error 59 us; skew 500 ppm
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:27.677838 16293 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:27.678795 16293 webserver.cc:460] Webserver started at http://127.11.225.65:42473/ using document root <none> and password file <none>
I20260811 14:58:27.679432 16293 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:27.679494 16293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:27.679770 16293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:27.681969 16293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "1d883b0824bd435da3c7b88ca4fb9c9f"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "b2642b1fa3f3b7b2334d63c8131bcae0"
server_key_iv: "e8fefabf5467a8a80db2c5c87287b45d"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.682565 16293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "1d883b0824bd435da3c7b88ca4fb9c9f"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "b2642b1fa3f3b7b2334d63c8131bcae0"
server_key_iv: "e8fefabf5467a8a80db2c5c87287b45d"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.686616 16293 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:58:27.689324 16320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.690634 16293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:27.690774 16293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "1d883b0824bd435da3c7b88ca4fb9c9f"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "b2642b1fa3f3b7b2334d63c8131bcae0"
server_key_iv: "e8fefabf5467a8a80db2c5c87287b45d"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.690886 16293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:27.721742 16293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:27.725348 16293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:27.725559 16293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:27.726227 16293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:27.727240 16293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:27.727315 16293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.727385 16293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:27.727417 16293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.738569 16293 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:39883
I20260811 14:58:27.738627 16496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:39883 every 8 connection(s)
I20260811 14:58:27.739518 16293 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:27.745540 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16293
I20260811 14:58:27.745676 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:27.746079 12165 external_mini_cluster.cc:1428] Setting key 984e013589d99d98196749e23931e0ca
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:27.756449 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:27.741491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:35909 (local address 127.11.225.126:34165)
0811 14:58:27.741632 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:27.741642 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:27.743193 (+ 1551us) server_negotiation.cc:407] Connection header received
0811 14:58:27.744185 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:27.744188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:27.744249 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:27.744340 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:27.745644 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.746279 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.747800 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.748099 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.748165 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:27.751121 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:27.751128 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:27.751133 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:27.751176 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:27.753387 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.754207 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.754214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.754219 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.754328 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.754810 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.754816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.754821 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.755144 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:27.755268 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:27.756093 (+ 825us) server_negotiation.cc:299] Negotiation successful
0811 14:58:27.756241 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:27.758071 16501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:27.742099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:34165 (local address 127.11.225.65:35909)
0811 14:58:27.743027 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:27.743075 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:27.743964 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:27.744536 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:27.744543 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:27.744900 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:27.745493 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:27.745510 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.746411 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.746417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:27.747623 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:27.747637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.748335 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.748337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:27.748481 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:27.749119 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:27.749136 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:27.750903 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:27.753584 (+ 2681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:27.753593 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:27.753614 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:27.754067 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:27.754452 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:27.754457 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:27.754469 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:27.754688 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:27.755281 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:27.755292 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:27.755714 (+ 422us) client_negotiation.cc:769] Sending connection context
0811 14:58:27.756035 (+ 321us) client_negotiation.cc:240] Negotiation successful
0811 14:58:27.756459 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":182,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:27.759573 16498 heartbeater.cc:347] Connected to a master server at 127.11.225.126:34165
I20260811 14:58:27.759859 16498 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:27.760442 16498 heartbeater.cc:511] Master 127.11.225.126:34165 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:27.762676 16203 ts_manager.cc:194] Registered new tserver with Master: 1d883b0824bd435da3c7b88ca4fb9c9f (127.11.225.65:39883)
I20260811 14:58:27.764794 16203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:35909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:27.778337 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:27.896107 16506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:27.896374 16506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:27.896417 16506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:27.900590 16506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:27.900650 16506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:27.900732 16506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:27.906045 16506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:27.907099 16506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:27.908136 16506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:58:27.918399 16506 server_base.cc:1034] running on GCE node
W20260811 14:58:27.918354 16520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:27.918324 16516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:27.918335 16517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:27.919047 16506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:27.919685 16506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:27.920890 16506 hybrid_clock.cc:648] HybridClock initialized: now 1786460307920874 us; error 31 us; skew 500 ppm
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:27.923719 16506 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:27.924623 16506 webserver.cc:460] Webserver started at http://127.11.225.66:40035/ using document root <none> and password file <none>
I20260811 14:58:27.925194 16506 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:27.925339 16506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:27.925578 16506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:27.927588 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "911341d66a6f4e91896ec814a4037fe3"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "84ed1ad247666d6d7bd7b4278c0ec5fa"
server_key_iv: "a2c9f3c6a7bb84cafe27e012fb5cde8b"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.928156 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "911341d66a6f4e91896ec814a4037fe3"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "84ed1ad247666d6d7bd7b4278c0ec5fa"
server_key_iv: "a2c9f3c6a7bb84cafe27e012fb5cde8b"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.931921 16506 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 14:58:27.934705 16532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.936028 16506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 14:58:27.936178 16506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "911341d66a6f4e91896ec814a4037fe3"
format_stamp: "Formatted at 2026-08-11 14:58:27 on dist-test-slave-8hhm"
server_key: "84ed1ad247666d6d7bd7b4278c0ec5fa"
server_key_iv: "a2c9f3c6a7bb84cafe27e012fb5cde8b"
server_key_version: "encryptionkey@0"
I20260811 14:58:27.936299 16506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:27.958354 16506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:27.961366 16506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:27.961572 16506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:27.962183 16506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:27.963040 16506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:27.963114 16506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.963186 16506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:27.963240 16506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:27.972321 16506 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:33609
I20260811 14:58:27.972352 16718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:33609 every 8 connection(s)
I20260811 14:58:27.973280 16506 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:27.975625 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16506
I20260811 14:58:27.975733 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:27.976017 12165 external_mini_cluster.cc:1428] Setting key aec730f86d4c474751fd9e0da624efd0
Aug 11 14:58:27 dist-test-slave-8hhm krb5kdc[16128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460307, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:27.988472 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:27.975535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:44483 (local address 127.11.225.126:34165)
0811 14:58:27.975712 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:27.975718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:27.976756 (+ 1038us) server_negotiation.cc:407] Connection header received
0811 14:58:27.977770 (+ 1014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:27.977775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:27.977831 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:27.977926 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:27.979227 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.980061 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.981275 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.981667 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.981787 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:27.984539 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:27.984547 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:27.984552 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:27.984587 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:27.986338 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.986858 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.986863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.986866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.986970 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:27.987304 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:27.987310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:27.987315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:27.987577 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:27.987691 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:27.988174 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 14:58:27.988294 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 14:58:27.989529 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:27.975846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:34165 (local address 127.11.225.66:44483)
0811 14:58:27.976604 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:27.976660 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:27.977566 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:27.978081 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:27.978088 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:27.978436 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:27.978916 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:27.978929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.980228 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.980231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:27.981107 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:27.981116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:27.981826 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:27.981829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:27.981969 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:27.982661 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:27.982689 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:27.984364 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:27.986455 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:27.986460 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:27.986472 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:27.986744 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:27.987065 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:27.987068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:27.987069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:27.987203 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:27.987692 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:27.987698 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:27.987925 (+ 227us) client_negotiation.cc:769] Sending connection context
0811 14:58:27.988082 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:58:27.988468 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":143,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:27.990746 16719 heartbeater.cc:347] Connected to a master server at 127.11.225.126:34165
I20260811 14:58:27.991008 16719 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:27.991518 16719 heartbeater.cc:511] Master 127.11.225.126:34165 requested a full tablet report, sending...
I20260811 14:58:27.992642 16203 ts_manager.cc:194] Registered new tserver with Master: 911341d66a6f4e91896ec814a4037fe3 (127.11.225.66:33609)
I20260811 14:58:27.993291 16203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:44483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:28.008354 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:28.123524 16735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:28.123821 16735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:28.123927 16735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:28.127960 16735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:28.128046 16735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:28.128139 16735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:28.133417 16735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:34165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:28.134498 16735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:28.135569 16735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:28.145695 16746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:28.145860 16735 server_base.cc:1034] running on GCE node
W20260811 14:58:28.145695 16751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:28.146036 16745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:28.146432 16735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:28.147106 16735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:28.148295 16735 hybrid_clock.cc:648] HybridClock initialized: now 1786460308148274 us; error 31 us; skew 500 ppm
Aug 11 14:58:28 dist-test-slave-8hhm krb5kdc[16128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460308, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:28.151321 16735 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:28.152139 16735 webserver.cc:460] Webserver started at http://127.11.225.67:45347/ using document root <none> and password file <none>
I20260811 14:58:28.152648 16735 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:28.152706 16735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:28.152871 16735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:28.155117 16735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "707bafcf83064d11bdf321abf115fadc"
format_stamp: "Formatted at 2026-08-11 14:58:28 on dist-test-slave-8hhm"
server_key: "4b1afb4a74571e1688733b22570e41bb"
server_key_iv: "5f25747049297a2aeebf8bce36880eb2"
server_key_version: "encryptionkey@0"
I20260811 14:58:28.155653 16735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "707bafcf83064d11bdf321abf115fadc"
format_stamp: "Formatted at 2026-08-11 14:58:28 on dist-test-slave-8hhm"
server_key: "4b1afb4a74571e1688733b22570e41bb"
server_key_iv: "5f25747049297a2aeebf8bce36880eb2"
server_key_version: "encryptionkey@0"
I20260811 14:58:28.159546 16735 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 14:58:28.161998 16761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:28.163223 16735 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:58:28.163347 16735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "707bafcf83064d11bdf321abf115fadc"
format_stamp: "Formatted at 2026-08-11 14:58:28 on dist-test-slave-8hhm"
server_key: "4b1afb4a74571e1688733b22570e41bb"
server_key_iv: "5f25747049297a2aeebf8bce36880eb2"
server_key_version: "encryptionkey@0"
I20260811 14:58:28.163452 16735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:28.175403 16735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:28.178735 16735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:28.178933 16735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:28.179533 16735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:28.180368 16735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:28.180441 16735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:28.180500 16735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:28.180552 16735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:28.190085 16735 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:45227
I20260811 14:58:28.190116 16972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:45227 every 8 connection(s)
I20260811 14:58:28.190946 16735 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:28.195323 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16735
I20260811 14:58:28.195462 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:28.195771 12165 external_mini_cluster.cc:1428] Setting key 6130d1605e7d343ca25911087d246b91
Aug 11 14:58:28 dist-test-slave-8hhm krb5kdc[16128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460308, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:28.205158 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:28.192856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:36941 (local address 127.11.225.126:34165)
0811 14:58:28.193032 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:28.193036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:28.194344 (+ 1308us) server_negotiation.cc:407] Connection header received
0811 14:58:28.195507 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:28.195512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:28.195583 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:28.195688 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:28.197177 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:28.197790 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:28.199045 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:28.199264 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:28.199349 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:28.201769 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:28.201772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:28.201774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:28.201797 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:28.203295 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:28.203798 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:28.203800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:28.203802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:28.203878 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:28.204225 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:28.204227 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:28.204228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:28.204389 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:28.204481 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:28.204923 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 14:58:28.205041 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:28.205991 16976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:28.193304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:34165 (local address 127.11.225.67:36941)
0811 14:58:28.194189 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:28.194235 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:28.195236 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:28.195887 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:28.195899 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:28.196408 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:28.197014 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:28.197036 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:28.197934 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:28.197938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:28.198908 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:28.198919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:28.199408 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:28.199411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:28.199559 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:28.200104 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:28.200121 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:28.201611 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:28.203412 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:28.203417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:28.203429 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:28.203701 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:28.203980 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:28.203982 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:28.203983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:28.204134 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:28.204492 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:28.204498 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:28.204717 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 14:58:28.204879 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 14:58:28.205159 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":180,"threads_started":1}
I20260811 14:58:28.207162 16974 heartbeater.cc:347] Connected to a master server at 127.11.225.126:34165
I20260811 14:58:28.207420 16974 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:28.207928 16974 heartbeater.cc:511] Master 127.11.225.126:34165 requested a full tablet report, sending...
I20260811 14:58:28.209085 16203 ts_manager.cc:194] Registered new tserver with Master: 707bafcf83064d11bdf321abf115fadc (127.11.225.67:45227)
I20260811 14:58:28.209868 16203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:36941
I20260811 14:58:28.210687 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:58:28.226310 16254 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:28.224744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.11.225.126:34165)
0811 14:58:28.224885 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:28.224889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:28.225114 (+ 225us) server_negotiation.cc:407] Connection header received
0811 14:58:28.225197 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:28.225200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:28.225318 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:28.225396 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:28.226159 (+ 763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42934: BlockingRecv error: recv got EOF from 127.0.0.1:42934 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 14:58:28.227978 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16293
I20260811 14:58:28.243304 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16506
I20260811 14:58:28.256445 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16735
I20260811 14:58:28.271564 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16146
2026-08-11T14:58:28Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2518 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:28 dist-test-slave-8hhm krb5kdc[16992](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:28 dist-test-slave-8hhm krb5kdc[16992](info): set up 2 sockets
Aug 11 14:58:28 dist-test-slave-8hhm krb5kdc[16992](info): commencing operation
krb5kdc: starting...
W20260811 14:58:29.578960 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:29 dist-test-slave-8hhm krb5kdc[16992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:29.700120 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42257
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:42257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:29.813154 17016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:29.813473 17016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:29.813546 17016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:29.817581 17016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:29.817682 17016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:29.817718 17016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:29.817756 17016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:29.817786 17016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:29.823076 17016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:42257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:29.824194 17016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:29.825315 17016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:29.834303 17023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:29.834275 17031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:29.834297 17025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:29.834607 17016 server_base.cc:1034] running on GCE node
I20260811 14:58:29.835240 17016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:29.836341 17016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:29.837533 17016 hybrid_clock.cc:648] HybridClock initialized: now 1786460309837520 us; error 31 us; skew 500 ppm
Aug 11 14:58:29 dist-test-slave-8hhm krb5kdc[16992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460309, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:29.840381 17016 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:29.841415 17016 webserver.cc:460] Webserver started at http://127.11.225.126:34071/ using document root <none> and password file <none>
I20260811 14:58:29.841988 17016 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:29.842082 17016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:29.842327 17016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:29.844463 17016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "f89ff9667bdd429290c8bc43ac269904"
format_stamp: "Formatted at 2026-08-11 14:58:29 on dist-test-slave-8hhm"
server_key: "dfe7e0cd94f782dd552da9ca780c8a88"
server_key_iv: "4904fc635037479d24b255392f682c3d"
server_key_version: "encryptionkey@0"
I20260811 14:58:29.845077 17016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "f89ff9667bdd429290c8bc43ac269904"
format_stamp: "Formatted at 2026-08-11 14:58:29 on dist-test-slave-8hhm"
server_key: "dfe7e0cd94f782dd552da9ca780c8a88"
server_key_iv: "4904fc635037479d24b255392f682c3d"
server_key_version: "encryptionkey@0"
I20260811 14:58:29.848930 17016 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 14:58:29.851528 17041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:29.852788 17016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:29.852949 17016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "f89ff9667bdd429290c8bc43ac269904"
format_stamp: "Formatted at 2026-08-11 14:58:29 on dist-test-slave-8hhm"
server_key: "dfe7e0cd94f782dd552da9ca780c8a88"
server_key_iv: "4904fc635037479d24b255392f682c3d"
server_key_version: "encryptionkey@0"
I20260811 14:58:29.853060 17016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:29.869678 17016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:29.872882 17016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:29.873112 17016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:29.880716 17016 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:42257
I20260811 14:58:29.881057 17132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:42257 every 8 connection(s)
I20260811 14:58:29.881786 17016 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:29.884737 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:29.886845 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17016
I20260811 14:58:29.886987 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:29.887277 12165 external_mini_cluster.cc:1428] Setting key f5cdcae7bedda8f77f0783e05226a0a2
I20260811 14:58:29.891505 17134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904: Bootstrap starting.
I20260811 14:58:29.894217 17134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:29.895113 17134 log.cc:824] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904: Log is configured to *not* fsync() on all Append() calls
Aug 11 14:58:29 dist-test-slave-8hhm krb5kdc[16992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:29.897421 17134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904: No bootstrap required, opened a new log
I20260811 14:58:29.902292 17134 raft_consensus.cc:348] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } }
I20260811 14:58:29.902575 17134 raft_consensus.cc:374] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:29.902623 17134 raft_consensus.cc:729] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89ff9667bdd429290c8bc43ac269904, State: Initialized, Role: FOLLOWER
I20260811 14:58:29.903134 17134 consensus_queue.cc:260] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } }
I20260811 14:58:29.903290 17134 raft_consensus.cc:388] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:29.903349 17140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:29.888652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34698 (local address 127.11.225.126:42257)
0811 14:58:29.889115 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:29.889137 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:29.889184 (+ 47us) server_negotiation.cc:407] Connection header received
0811 14:58:29.890237 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:29.890263 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:29.890696 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:29.891070 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:29.891866 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:29.893375 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:29.894255 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:29.894939 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:29.895129 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:29.897976 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:29.897991 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:29.898009 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:29.898040 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:29.900074 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:29.900515 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:29.900522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:29.900528 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:29.900673 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:29.901006 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:29.901009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:29.901011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:29.901560 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:29.901768 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:29.902039 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 14:58:29.902335 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":123,"threads_started":1}
I20260811 14:58:29.903357 17134 raft_consensus.cc:482] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:29.903488 17134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:29.904421 17134 raft_consensus.cc:504] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } }
I20260811 14:58:29.904779 17134 leader_election.cc:302] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f89ff9667bdd429290c8bc43ac269904; no voters:
I20260811 14:58:29.905117 17134 leader_election.cc:288] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:29.905186 17142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:29.905424 17142 raft_consensus.cc:686] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [term 1 LEADER]: Becoming Leader. State: Replica: f89ff9667bdd429290c8bc43ac269904, State: Running, Role: LEADER
I20260811 14:58:29.905742 17142 consensus_queue.cc:237] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } }
I20260811 14:58:29.906288 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:58:29.906464 17134 sys_catalog.cc:564] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:29.907003 17144 sys_catalog.cc:455] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f89ff9667bdd429290c8bc43ac269904. Latest consensus state: current_term: 1 leader_uuid: "f89ff9667bdd429290c8bc43ac269904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } } }
I20260811 14:58:29.907119 17144 sys_catalog.cc:458] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:29.907528 17145 sys_catalog.cc:455] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f89ff9667bdd429290c8bc43ac269904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f89ff9667bdd429290c8bc43ac269904" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42257 } } }
I20260811 14:58:29.907660 17145 sys_catalog.cc:458] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:29.907976 17149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:29.911346 17149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:29.917078 17149 catalog_manager.cc:1347] Generated new cluster ID: 972037f376b04e9381d0465a51ead099
I20260811 14:58:29.917160 17149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:29.928229 17140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:29.922446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34704 (local address 127.11.225.126:42257)
0811 14:58:29.922568 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:29.922573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:29.922856 (+ 283us) server_negotiation.cc:407] Connection header received
0811 14:58:29.922966 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:29.922970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:29.923025 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:29.923117 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:29.923714 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:29.924505 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:29.925713 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:29.926085 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:29.926188 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:29.927184 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:29.927188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:29.927191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:29.927731 (+ 540us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:29.927767 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:29.927790 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:29.927891 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:29.928013 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 14:58:29.928073 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 14:58:29.929832 17149 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:29.930660 17149 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:29.939618 17149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f89ff9667bdd429290c8bc43ac269904: Generated new TSK 0
I20260811 14:58:29.940342 17149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:58:29.947469 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17016
2026-08-11T14:58:29Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1680 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:30 dist-test-slave-8hhm krb5kdc[17188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:30 dist-test-slave-8hhm krb5kdc[17188](info): set up 2 sockets
Aug 11 14:58:30 dist-test-slave-8hhm krb5kdc[17188](info): commencing operation
krb5kdc: starting...
W20260811 14:58:31.283355 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:31 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:31.412117 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41207
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:31.524647 17220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:31.524935 17220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:31.525017 17220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:31.528967 17220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:31.529058 17220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:31.529098 17220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:31.529153 17220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:31.529191 17220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:31.534303 17220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:31.535310 17220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:31.536319 17220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:31.545069 17237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:31.545069 17230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:31.545162 17227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:31.545392 17220 server_base.cc:1034] running on GCE node
I20260811 14:58:31.546041 17220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:31.547134 17220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:31.548326 17220 hybrid_clock.cc:648] HybridClock initialized: now 1786460311548307 us; error 32 us; skew 500 ppm
Aug 11 14:58:31 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460311, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:31.551647 17220 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:31.552578 17220 webserver.cc:460] Webserver started at http://127.11.225.126:46435/ using document root <none> and password file <none>
I20260811 14:58:31.553149 17220 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:31.553283 17220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:31.553503 17220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:31.555706 17220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "160bbf3eb0ea41629cb2107b696e3ca5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "4bbe2c7afd277fea580aa2438d67a2d1"
server_key_iv: "b378f73353bf577486e1cd44e7a704cb"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.556298 17220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "160bbf3eb0ea41629cb2107b696e3ca5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "4bbe2c7afd277fea580aa2438d67a2d1"
server_key_iv: "b378f73353bf577486e1cd44e7a704cb"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.560526 17220 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 14:58:31.563199 17248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:31.564476 17220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:31.564581 17220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "160bbf3eb0ea41629cb2107b696e3ca5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "4bbe2c7afd277fea580aa2438d67a2d1"
server_key_iv: "b378f73353bf577486e1cd44e7a704cb"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.564682 17220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:31.587785 17220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:31.591439 17220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:31.591634 17220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:31.599161 17220 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41207
I20260811 14:58:31.599495 17334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41207 every 8 connection(s)
I20260811 14:58:31.600170 17220 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:31.602952 17335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:31.608448 17335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: Bootstrap starting.
I20260811 14:58:31.609046 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17220
I20260811 14:58:31.609175 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:31.609484 12165 external_mini_cluster.cc:1428] Setting key 61940650d70d55c072208869a74d88fb
I20260811 14:58:31.611145 17335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:31.611908 17335 log.cc:824] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:31.614157 17335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: No bootstrap required, opened a new log
I20260811 14:58:31.618780 17335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } }
I20260811 14:58:31.619024 17335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:31.619108 17335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 160bbf3eb0ea41629cb2107b696e3ca5, State: Initialized, Role: FOLLOWER
Aug 11 14:58:31 dist-test-slave-8hhm krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:31.619634 17335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } }
I20260811 14:58:31.619808 17335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:31.619910 17335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:31.620007 17335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:31.620870 17335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } }
I20260811 14:58:31.621258 17335 leader_election.cc:302] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 160bbf3eb0ea41629cb2107b696e3ca5; no voters:
I20260811 14:58:31.621632 17335 leader_election.cc:288] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:31.621745 17343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:31.622010 17343 raft_consensus.cc:686] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 160bbf3eb0ea41629cb2107b696e3ca5, State: Running, Role: LEADER
I20260811 14:58:31.622385 17343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } }
I20260811 14:58:31.623068 17335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:31.624317 17349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } } }
I20260811 14:58:31.624432 17349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:31.624727 17350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 160bbf3eb0ea41629cb2107b696e3ca5. Latest consensus state: current_term: 1 leader_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "160bbf3eb0ea41629cb2107b696e3ca5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41207 } } }
I20260811 14:58:31.624814 17350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:31.626148 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:31.610769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41294 (local address 127.11.225.126:41207)
0811 14:58:31.611179 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:31.611195 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:31.611229 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:58:31.611899 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:31.611916 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:31.612377 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:31.612753 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:31.613732 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.614874 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.616142 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.616620 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.616744 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:31.619782 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:31.619787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:31.619821 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:31.619853 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:31.622117 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:31.622640 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:31.622646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:31.622652 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:31.622819 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:31.623167 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:31.623172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:31.623174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:31.623676 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:31.624613 (+ 937us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:31.624770 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 14:58:31.625102 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":144,"threads_started":1}
W20260811 14:58:31.628387 17368 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:58:31.628466 17368 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:58:31.628554 17358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:31.629442 17358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:31.635042 17358 catalog_manager.cc:1347] Generated new cluster ID: 9a5d5c65dc9f4b51b604034bc0a037a5
I20260811 14:58:31.635104 17358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:31.658754 17358 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:31.659713 17358 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:31.670362 17358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 160bbf3eb0ea41629cb2107b696e3ca5: Generated new TSK 0
I20260811 14:58:31.671052 17358 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:31.705794 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:31.841470 17374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:31.841746 17374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:31.841789 17374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:31.846109 17374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:31.846167 17374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:31.846257 17374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:31.851373 17374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:31.852398 17374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:31.853471 17374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:31.863243 17390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:31.863375 17388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:31.863248 17386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:31.863477 17374 server_base.cc:1034] running on GCE node
I20260811 14:58:31.864050 17374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:31.864735 17374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:31.865899 17374 hybrid_clock.cc:648] HybridClock initialized: now 1786460311865869 us; error 41 us; skew 500 ppm
Aug 11 14:58:31 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460311, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:31.868813 17374 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:31.869819 17374 webserver.cc:460] Webserver started at http://127.11.225.65:45717/ using document root <none> and password file <none>
I20260811 14:58:31.870420 17374 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:31.870522 17374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:31.870760 17374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:31.872844 17374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "3f75f8a191254c36976225b9b3a55ef5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "dfd80c980bb403b2ce2fc06f04f94616"
server_key_iv: "435a71af61e35847d9d5b82120715f5d"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.873481 17374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "3f75f8a191254c36976225b9b3a55ef5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "dfd80c980bb403b2ce2fc06f04f94616"
server_key_iv: "435a71af61e35847d9d5b82120715f5d"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.877206 17374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:31.879663 17400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:31.880934 17374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:31.881059 17374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "3f75f8a191254c36976225b9b3a55ef5"
format_stamp: "Formatted at 2026-08-11 14:58:31 on dist-test-slave-8hhm"
server_key: "dfd80c980bb403b2ce2fc06f04f94616"
server_key_iv: "435a71af61e35847d9d5b82120715f5d"
server_key_version: "encryptionkey@0"
I20260811 14:58:31.881194 17374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:31.903772 17374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:31.906744 17374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:31.906957 17374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:31.907599 17374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:31.908463 17374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:31.908535 17374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:31.908609 17374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:31.908663 17374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:31.918010 17374 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:35451
I20260811 14:58:31.918049 17611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:35451 every 8 connection(s)
I20260811 14:58:31.918982 17374 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:31.925794 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17374
I20260811 14:58:31.925935 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:31.926218 12165 external_mini_cluster.cc:1428] Setting key f5f226b2219e2998e405ea452ed36c3c
Aug 11 14:58:31 dist-test-slave-8hhm krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460311, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:31.934322 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:31.920843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:38129 (local address 127.11.225.126:41207)
0811 14:58:31.920979 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:31.920982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:31.921862 (+ 880us) server_negotiation.cc:407] Connection header received
0811 14:58:31.923350 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:31.923356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:31.923423 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:31.923529 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:31.924856 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.925467 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.926792 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.927098 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.927190 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:31.929857 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:31.929864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:31.929871 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:31.929911 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:31.931776 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:31.932426 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:31.932429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:31.932431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:31.932542 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:31.932999 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:31.933005 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:31.933009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:31.933312 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:31.933413 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:31.934075 (+ 662us) server_negotiation.cc:299] Negotiation successful
0811 14:58:31.934192 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:58:31.935539 17618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:31.921171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41207 (local address 127.11.225.65:38129)
0811 14:58:31.921691 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:31.921733 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:31.923103 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:31.923715 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:31.923722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:31.924146 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:31.924702 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:31.924718 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.925607 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.925610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:31.926661 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:31.926673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:31.927254 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:31.927258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:31.927446 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:31.928164 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:31.928179 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:31.929670 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:31.931908 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:31.931917 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:31.931934 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:31.932312 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:31.932660 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:31.932666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:31.932671 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:31.932871 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:31.933437 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:31.933444 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:31.933783 (+ 339us) client_negotiation.cc:769] Sending connection context
0811 14:58:31.934018 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 14:58:31.934375 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":113,"threads_started":1}
I20260811 14:58:31.937098 17612 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41207
I20260811 14:58:31.937366 17612 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:31.937979 17612 heartbeater.cc:511] Master 127.11.225.126:41207 requested a full tablet report, sending...
I20260811 14:58:31.939452 17278 ts_manager.cc:194] Registered new tserver with Master: 3f75f8a191254c36976225b9b3a55ef5 (127.11.225.65:35451)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:31.940812 17278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:38129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:31.956957 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:32.078274 17625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:32.078583 17625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:32.078626 17625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:32.082659 17625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:32.082724 17625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:32.082823 17625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:32.088232 17625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:32.089304 17625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:32.090343 17625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:32.100487 17634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:32.100487 17636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:32.100544 17633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:32.100831 17625 server_base.cc:1034] running on GCE node
I20260811 14:58:32.101378 17625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:32.101984 17625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:32.103212 17625 hybrid_clock.cc:648] HybridClock initialized: now 1786460312103198 us; error 34 us; skew 500 ppm
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:32.106160 17625 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:32.107028 17625 webserver.cc:460] Webserver started at http://127.11.225.66:45787/ using document root <none> and password file <none>
I20260811 14:58:32.107586 17625 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:32.107676 17625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:32.107901 17625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:32.109990 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "2a653874d10149e8944971cd0289691f"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "3fac7af7a547dd3aea7e0452d5aa7f96"
server_key_iv: "facf95ec661a1d3cf2f72fda3c450f0d"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.110571 17625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "2a653874d10149e8944971cd0289691f"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "3fac7af7a547dd3aea7e0452d5aa7f96"
server_key_iv: "facf95ec661a1d3cf2f72fda3c450f0d"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.114260 17625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 14:58:32.116597 17650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.117900 17625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:32.118069 17625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "2a653874d10149e8944971cd0289691f"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "3fac7af7a547dd3aea7e0452d5aa7f96"
server_key_iv: "facf95ec661a1d3cf2f72fda3c450f0d"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.118199 17625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:32.144783 17625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:32.147873 17625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:32.148110 17625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:32.148736 17625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:32.149679 17625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:32.149749 17625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.149824 17625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:32.149866 17625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.159041 17625 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:46815
I20260811 14:58:32.159073 17850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:46815 every 8 connection(s)
I20260811 14:58:32.159955 17625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:32.164438 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17625
I20260811 14:58:32.164588 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:32.164863 12165 external_mini_cluster.cc:1428] Setting key 158650dd8f6df710c0542e78ff8055bc
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:32.176218 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:32.161915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:53755 (local address 127.11.225.126:41207)
0811 14:58:32.162094 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:32.162098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:32.162942 (+ 844us) server_negotiation.cc:407] Connection header received
0811 14:58:32.164472 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:32.164477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:32.164545 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:32.164642 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:32.166162 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.166730 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.168541 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.168911 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.169024 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:32.172040 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:32.172046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:32.172052 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:32.172088 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:32.174057 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.174566 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.174573 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.174576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.174675 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.175014 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.175021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.175025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.175294 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:32.175401 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:32.175900 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 14:58:32.176045 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:32.176978 17853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:32.162282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41207 (local address 127.11.225.66:53755)
0811 14:58:32.162772 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:32.162818 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:32.164208 (+ 1390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:32.164839 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:32.164846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:32.165356 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:32.165961 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:32.165977 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.166886 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.166892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:32.168400 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:32.168415 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.169070 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.169073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:32.169299 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:32.170002 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:32.170028 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:32.171845 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:32.174184 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:32.174190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:32.174202 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:32.174456 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:32.174780 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:32.174782 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:32.174784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:32.174915 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:32.175400 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:32.175405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:32.175643 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 14:58:32.175800 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:58:32.176047 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":112,"threads_started":1}
I20260811 14:58:32.178272 17851 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41207
I20260811 14:58:32.178563 17851 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:32.179175 17851 heartbeater.cc:511] Master 127.11.225.126:41207 requested a full tablet report, sending...
I20260811 14:58:32.180287 17278 ts_manager.cc:194] Registered new tserver with Master: 2a653874d10149e8944971cd0289691f (127.11.225.66:46815)
I20260811 14:58:32.180882 17278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:53755
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:32.195434 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:32.311375 17856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:32.311626 17856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:32.311669 17856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:32.315706 17856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:32.315759 17856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:32.315852 17856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:32.321250 17856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:32.322412 17856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:32.323515 17856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:32.333583 17869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:32.333583 17865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:32.333609 17863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:32.334390 17856 server_base.cc:1034] running on GCE node
I20260811 14:58:32.334736 17856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:32.335292 17856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:32.336483 17856 hybrid_clock.cc:648] HybridClock initialized: now 1786460312336453 us; error 46 us; skew 500 ppm
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:32.339469 17856 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:32.340345 17856 webserver.cc:460] Webserver started at http://127.11.225.67:42497/ using document root <none> and password file <none>
I20260811 14:58:32.340937 17856 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:32.341056 17856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:32.341388 17856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:32.343513 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "d0ecd5310742489da473e9e6deab2cfe"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "fb7d27702cfacc6c8f01132818ecd507"
server_key_iv: "95f51b0123fad15e74c68fd75665af63"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.344137 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "d0ecd5310742489da473e9e6deab2cfe"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "fb7d27702cfacc6c8f01132818ecd507"
server_key_iv: "95f51b0123fad15e74c68fd75665af63"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.348004 17856 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 14:58:32.350584 17886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.351768 17856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:32.351922 17856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "d0ecd5310742489da473e9e6deab2cfe"
format_stamp: "Formatted at 2026-08-11 14:58:32 on dist-test-slave-8hhm"
server_key: "fb7d27702cfacc6c8f01132818ecd507"
server_key_iv: "95f51b0123fad15e74c68fd75665af63"
server_key_version: "encryptionkey@0"
I20260811 14:58:32.352039 17856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:32.362988 17856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:32.365824 17856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:32.366025 17856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:32.366595 17856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:32.367395 17856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:32.367467 17856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.367547 17856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:32.367590 17856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:32.376559 17856 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:45001
I20260811 14:58:32.376590 18110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:45001 every 8 connection(s)
I20260811 14:58:32.377439 17856 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:32.382085 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17856
I20260811 14:58:32.382177 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:32.382468 12165 external_mini_cluster.cc:1428] Setting key d1570d5a06d0e646a52b390232c6ff2d
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:32.391372 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:32.379186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:34149 (local address 127.11.225.126:41207)
0811 14:58:32.379350 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:32.379362 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:32.380197 (+ 835us) server_negotiation.cc:407] Connection header received
0811 14:58:32.381617 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:32.381621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:32.381679 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:32.381785 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:32.383148 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.383893 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.385300 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.385534 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.385637 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:32.388055 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:32.388058 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:32.388060 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:32.388084 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:32.389465 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.389925 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.389927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.389928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.390033 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.390363 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.390366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.390368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.390581 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:32.390678 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:32.391133 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 14:58:32.391239 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 14:58:32.392168 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:32.379614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41207 (local address 127.11.225.67:34149)
0811 14:58:32.380051 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:32.380093 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:32.381412 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:32.381956 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:32.381963 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:32.382405 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:32.382975 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:32.382993 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.384053 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.384056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:32.385142 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:32.385152 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.385679 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.385682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:32.385815 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:32.386394 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:32.386411 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:32.387880 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:32.389576 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:32.389581 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:32.389592 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:32.389835 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:32.390115 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:32.390117 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:32.390118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:32.390243 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:32.390688 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:32.390693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:32.390907 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 14:58:32.391065 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 14:58:32.391301 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":113,"threads_started":1}
I20260811 14:58:32.393448 18111 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41207
I20260811 14:58:32.393714 18111 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:32.394228 18111 heartbeater.cc:511] Master 127.11.225.126:41207 requested a full tablet report, sending...
I20260811 14:58:32.395367 17278 ts_manager.cc:194] Registered new tserver with Master: d0ecd5310742489da473e9e6deab2cfe (127.11.225.67:45001)
I20260811 14:58:32.396051 17278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:34149
I20260811 14:58:32.396723 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[17188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460312, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:32.426316 17340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:32.417003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41306 (local address 127.11.225.126:41207)
0811 14:58:32.417184 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:32.417189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:32.417396 (+ 207us) server_negotiation.cc:407] Connection header received
0811 14:58:32.417586 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:32.417589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:32.417644 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:32.417732 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:32.418459 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.419142 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.420005 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:32.420232 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:32.420340 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:32.423008 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:32.423011 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:32.423022 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:32.423055 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:32.424541 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.424978 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.424982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.424984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.425078 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:32.425386 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:32.425390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:32.425391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:32.425626 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:32.425772 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:32.426023 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 14:58:32.426144 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 14:58:32.426774 17276 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41306
I20260811 14:58:32.427865 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17374
I20260811 14:58:32.462950 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17625
I20260811 14:58:32.474406 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17856
I20260811 14:58:32.486589 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17220
2026-08-11T14:58:32Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2538 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[18131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[18131](info): set up 2 sockets
Aug 11 14:58:32 dist-test-slave-8hhm krb5kdc[18131](info): commencing operation
krb5kdc: starting...
W20260811 14:58:33.794224 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:33 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:33.923810 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35657
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:35657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:34.037446 18157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:34.037699 18157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:34.037737 18157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:34.041556 18157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:34.041605 18157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:34.041625 18157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:34.041688 18157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:34.041724 18157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:34.047472 18157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:35657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:34.048533 18157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:34.049626 18157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:34.058070 18174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.058125 18167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.058127 18165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.058337 18157 server_base.cc:1034] running on GCE node
I20260811 14:58:34.059092 18157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:34.060201 18157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:34.061349 18157 hybrid_clock.cc:648] HybridClock initialized: now 1786460314061335 us; error 26 us; skew 500 ppm
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:34.064160 18157 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:34.065047 18157 webserver.cc:460] Webserver started at http://127.11.225.126:43739/ using document root <none> and password file <none>
I20260811 14:58:34.065675 18157 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:34.065771 18157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:34.066008 18157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:34.068095 18157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "5e683834a3df488bb109436c2e9de068"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "a7b5a10610ea9a37060df049ce391c61"
server_key_iv: "4ffd8e4e31877c605870febaf5c3e8a9"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.068673 18157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "5e683834a3df488bb109436c2e9de068"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "a7b5a10610ea9a37060df049ce391c61"
server_key_iv: "4ffd8e4e31877c605870febaf5c3e8a9"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.072403 18157 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 14:58:34.074846 18185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.076084 18157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:34.076241 18157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "5e683834a3df488bb109436c2e9de068"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "a7b5a10610ea9a37060df049ce391c61"
server_key_iv: "4ffd8e4e31877c605870febaf5c3e8a9"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.076361 18157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:34.087517 18157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:34.090409 18157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:34.090610 18157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:34.097826 18157 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:35657
I20260811 14:58:34.097851 18279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:35657 every 8 connection(s)
I20260811 14:58:34.098814 18157 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:34.100245 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18157
I20260811 14:58:34.100368 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:34.100667 12165 external_mini_cluster.cc:1428] Setting key 8d9f8b2c3ac0b01d2c27da63e413364b
I20260811 14:58:34.102137 18281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:34.108932 18281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068: Bootstrap starting.
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:34.111742 18281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:34.112676 18281 log.cc:824] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:34.115157 18281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068: No bootstrap required, opened a new log
I20260811 14:58:34.115695 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.102018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53556 (local address 127.11.225.126:35657)
0811 14:58:34.102466 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.102483 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.102517 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:58:34.103194 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.103211 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.103513 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.103789 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.104736 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.105821 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.106998 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.107430 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.107539 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.110424 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.110430 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.110445 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.110477 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.112484 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.112946 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.112952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.112958 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.113113 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.113453 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.113455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.113456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.113983 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.114218 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.114447 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.114738 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":158,"threads_started":1}
I20260811 14:58:34.119168 18281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } }
I20260811 14:58:34.119386 18281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:34.119428 18281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e683834a3df488bb109436c2e9de068, State: Initialized, Role: FOLLOWER
I20260811 14:58:34.119786 18281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } }
I20260811 14:58:34.119895 18281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:34.119938 18281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:34.120024 18281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:34.120872 18281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } }
I20260811 14:58:34.121184 18281 leader_election.cc:302] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e683834a3df488bb109436c2e9de068; no voters:
I20260811 14:58:34.121557 18281 leader_election.cc:288] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:34.121654 18287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:34.121902 18287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [term 1 LEADER]: Becoming Leader. State: Replica: 5e683834a3df488bb109436c2e9de068, State: Running, Role: LEADER
I20260811 14:58:34.122331 18287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } }
I20260811 14:58:34.122980 18281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:34.124104 18292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e683834a3df488bb109436c2e9de068. Latest consensus state: current_term: 1 leader_uuid: "5e683834a3df488bb109436c2e9de068" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } } }
I20260811 14:58:34.124248 18292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:34.124547 18288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e683834a3df488bb109436c2e9de068" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e683834a3df488bb109436c2e9de068" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35657 } } }
I20260811 14:58:34.124634 18288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:34.124684 18302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:34.127431 18302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:34.133142 18302 catalog_manager.cc:1347] Generated new cluster ID: 98aecd225ba540f9a68f31626405b258
I20260811 14:58:34.133203 18302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:34.146351 18302 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:34.147229 18302 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:34.153435 18302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e683834a3df488bb109436c2e9de068: Generated new TSK 0
I20260811 14:58:34.154074 18302 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:34.183619 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:34.297997 18325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:34.298274 18325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:34.298352 18325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:34.302410 18325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:34.302500 18325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:34.302587 18325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:34.307730 18325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:34.308820 18325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:34.309903 18325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:34.319490 18333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.319604 18325 server_base.cc:1034] running on GCE node
W20260811 14:58:34.319536 18334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.319458 18336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.320103 18325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:34.320783 18325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:34.321974 18325 hybrid_clock.cc:648] HybridClock initialized: now 1786460314321947 us; error 38 us; skew 500 ppm
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:34.325260 18325 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:34.326120 18325 webserver.cc:460] Webserver started at http://127.11.225.65:45165/ using document root <none> and password file <none>
I20260811 14:58:34.326634 18325 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:34.326695 18325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:34.326861 18325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:34.328953 18325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "e122b77e711e4afba59ab016f845967e"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "e3040c716b2e3fbbf48d58eaf84e4df8"
server_key_iv: "41f014a885722ade28c88a8460a32856"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.329617 18325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "e122b77e711e4afba59ab016f845967e"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "e3040c716b2e3fbbf48d58eaf84e4df8"
server_key_iv: "41f014a885722ade28c88a8460a32856"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.333174 18325 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:34.335551 18351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.336745 18325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:34.336896 18325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "e122b77e711e4afba59ab016f845967e"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "e3040c716b2e3fbbf48d58eaf84e4df8"
server_key_iv: "41f014a885722ade28c88a8460a32856"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.337016 18325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:34.364881 18325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:34.367754 18325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:34.367961 18325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:34.368552 18325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:34.369443 18325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:34.369511 18325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.369583 18325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:34.369626 18325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.378796 18325 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:39233
I20260811 14:58:34.378825 18558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:39233 every 8 connection(s)
I20260811 14:58:34.379724 18325 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:34.380554 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18325
I20260811 14:58:34.380715 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:34.381034 12165 external_mini_cluster.cc:1428] Setting key c92e265b41041591dea772c0d26467d2
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:34.395669 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.381780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53867 (local address 127.11.225.126:35657)
0811 14:58:34.381931 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.381935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.382991 (+ 1056us) server_negotiation.cc:407] Connection header received
0811 14:58:34.385060 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.385063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.385118 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.385194 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.386454 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.387010 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.388846 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.389077 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.389159 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.392040 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.392043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.392045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.392070 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.393582 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.394091 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.394096 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.394097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.394179 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.394529 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.394533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.394535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.394716 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.394823 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.395340 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.395467 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:34.396478 18561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.382261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35657 (local address 127.11.225.65:53867)
0811 14:58:34.382810 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:34.382870 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:34.384825 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:34.385400 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:34.385407 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:34.385788 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:34.386303 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.386328 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.387152 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.387159 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.388714 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.388730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.389277 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.389286 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.389524 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.390152 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:34.390182 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:34.391854 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:34.393702 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.393708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.393723 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.393979 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.394275 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.394278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.394280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.394432 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.394834 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:34.394841 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:34.395074 (+ 233us) client_negotiation.cc:769] Sending connection context
0811 14:58:34.395266 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 14:58:34.395591 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":157,"threads_started":1}
I20260811 14:58:34.397884 18559 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35657
I20260811 14:58:34.398147 18559 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:34.398759 18559 heartbeater.cc:511] Master 127.11.225.126:35657 requested a full tablet report, sending...
I20260811 14:58:34.400627 18209 ts_manager.cc:194] Registered new tserver with Master: e122b77e711e4afba59ab016f845967e (127.11.225.65:39233)
I20260811 14:58:34.402451 18209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:53867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:34.412369 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:34.527597 18567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:34.527859 18567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:34.527902 18567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:34.532020 18567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:34.532076 18567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:34.532133 18567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:34.537338 18567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:34.538388 18567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:34.539371 18567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:34.549609 18581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.549651 18576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.549620 18577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.549911 18567 server_base.cc:1034] running on GCE node
I20260811 14:58:34.550307 18567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:34.550956 18567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:34.552129 18567 hybrid_clock.cc:648] HybridClock initialized: now 1786460314552088 us; error 52 us; skew 500 ppm
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:34.555126 18567 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:34.556072 18567 webserver.cc:460] Webserver started at http://127.11.225.66:41331/ using document root <none> and password file <none>
I20260811 14:58:34.556655 18567 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:34.556751 18567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:34.556991 18567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:34.559208 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "6493038167764e6d89eb0dcb7607ce58"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "11b2846cd50e86a6f69d5f5a0d97c095"
server_key_iv: "05e0cb5308053337769dd1797b28d9f0"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.559782 18567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "6493038167764e6d89eb0dcb7607ce58"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "11b2846cd50e86a6f69d5f5a0d97c095"
server_key_iv: "05e0cb5308053337769dd1797b28d9f0"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.563483 18567 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 14:58:34.565858 18592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.567004 18567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:34.567143 18567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "6493038167764e6d89eb0dcb7607ce58"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "11b2846cd50e86a6f69d5f5a0d97c095"
server_key_iv: "05e0cb5308053337769dd1797b28d9f0"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.567255 18567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:34.581120 18567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:34.583995 18567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:34.584211 18567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:34.584815 18567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:34.585736 18567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:34.585811 18567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.585882 18567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:34.585937 18567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.595083 18567 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35811
I20260811 14:58:34.595119 18774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35811 every 8 connection(s)
I20260811 14:58:34.595996 18567 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:34.599593 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18567
I20260811 14:58:34.599696 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:34.600003 12165 external_mini_cluster.cc:1428] Setting key 3b98ae46ff24ac8cdcb7757027bdeabf
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:34.610695 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.597800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:60387 (local address 127.11.225.126:35657)
0811 14:58:34.597938 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.597942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.598766 (+ 824us) server_negotiation.cc:407] Connection header received
0811 14:58:34.600327 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.600331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.600391 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.600498 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.601704 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.602218 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.603348 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.603580 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.603689 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.606565 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.606571 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.606577 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.606610 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.608428 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.608946 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.608952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.608956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.609054 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.609468 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.609472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.609474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.609734 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.609847 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.610350 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.610491 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:34.611402 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.598176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35657 (local address 127.11.225.66:60387)
0811 14:58:34.598618 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:34.598659 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:34.600107 (+ 1448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:34.600675 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:34.600682 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:34.601027 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:34.601566 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.601579 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.602344 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.602352 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.603222 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.603231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.603738 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.603742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.603903 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.604499 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:34.604515 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:34.606388 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:34.608563 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.608568 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.608580 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.608838 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.609160 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.609162 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.609163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.609370 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.609846 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:34.609851 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:34.610086 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 14:58:34.610235 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 14:58:34.610480 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":123,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:34.612660 18775 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35657
I20260811 14:58:34.612949 18775 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:34.613720 18775 heartbeater.cc:511] Master 127.11.225.126:35657 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:34.614936 18209 ts_manager.cc:194] Registered new tserver with Master: 6493038167764e6d89eb0dcb7607ce58 (127.11.225.66:35811)
I20260811 14:58:34.615543 18209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:60387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:34.631944 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:34.748620 18781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:34.748909 18781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:34.749003 18781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:34.753077 18781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:34.753160 18781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:34.753278 18781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:34.758615 18781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35657
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:34.759724 18781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:34.760802 18781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:34.770970 18788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:34.770999 18795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.771148 18781 server_base.cc:1034] running on GCE node
W20260811 14:58:34.771049 18791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:34.771581 18781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:34.772241 18781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:34.773430 18781 hybrid_clock.cc:648] HybridClock initialized: now 1786460314773416 us; error 25 us; skew 500 ppm
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:34.776197 18781 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:34.777124 18781 webserver.cc:460] Webserver started at http://127.11.225.67:41035/ using document root <none> and password file <none>
I20260811 14:58:34.777700 18781 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:34.777792 18781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:34.778101 18781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:34.780510 18781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "83672cc81e43467d9da9bfb01f5d435f"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "eac9238b6ed8f8d8e8533bcc95ed8559"
server_key_iv: "19cd05d1c8cbe66db8b5f9e569c9bac3"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.781126 18781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "83672cc81e43467d9da9bfb01f5d435f"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "eac9238b6ed8f8d8e8533bcc95ed8559"
server_key_iv: "19cd05d1c8cbe66db8b5f9e569c9bac3"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.784965 18781 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 14:58:34.787536 18806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.788846 18781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:34.789000 18781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "83672cc81e43467d9da9bfb01f5d435f"
format_stamp: "Formatted at 2026-08-11 14:58:34 on dist-test-slave-8hhm"
server_key: "eac9238b6ed8f8d8e8533bcc95ed8559"
server_key_iv: "19cd05d1c8cbe66db8b5f9e569c9bac3"
server_key_version: "encryptionkey@0"
I20260811 14:58:34.789141 18781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:34.800900 18781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:34.804075 18781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:34.804288 18781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:34.804913 18781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:34.805848 18781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:34.805922 18781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.805989 18781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:34.806043 18781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:34.815398 18781 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:39849
I20260811 14:58:34.815471 19002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:39849 every 8 connection(s)
I20260811 14:58:34.816361 18781 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:34.818964 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18781
I20260811 14:58:34.819098 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:34.819434 12165 external_mini_cluster.cc:1428] Setting key c0e309a144f2d2f2c27911e6bfc7af73
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:34.831154 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.818278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:54309 (local address 127.11.225.126:35657)
0811 14:58:34.818429 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.818434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.819429 (+ 995us) server_negotiation.cc:407] Connection header received
0811 14:58:34.821316 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.821320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.821373 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.821461 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.822825 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.823378 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.824874 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.825116 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.825299 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.827763 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.827766 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.827768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.827794 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.829195 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.829748 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.829751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.829752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.829831 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.830199 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.830202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.830203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.830380 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.830457 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.830909 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.831007 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 14:58:34.832120 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.818703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35657 (local address 127.11.225.67:54309)
0811 14:58:34.819246 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:34.819309 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:34.821065 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:34.821661 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:34.821669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:34.822088 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:34.822679 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.822694 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.823501 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.823503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.824737 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:34.824747 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.825366 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.825371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:34.825542 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.826129 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:34.826145 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:34.827609 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:34.829368 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.829373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.829384 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.829657 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.829939 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:34.829942 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:34.829944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:34.830094 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:34.830475 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:34.830481 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:34.830705 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 14:58:34.830860 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 14:58:34.831144 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":123,"threads_started":1}
I20260811 14:58:34.833448 19003 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35657
I20260811 14:58:34.833696 19003 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:34.834200 19003 heartbeater.cc:511] Master 127.11.225.126:35657 requested a full tablet report, sending...
I20260811 14:58:34.835266 18209 ts_manager.cc:194] Registered new tserver with Master: 83672cc81e43467d9da9bfb01f5d435f (127.11.225.67:39849)
I20260811 14:58:34.835805 18209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:54309
I20260811 14:58:34.845518 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:34.874496 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.864560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51490 (local address 127.11.225.65:39233)
0811 14:58:34.864924 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.864941 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.864964 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:58:34.865019 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.865024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.865321 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.865451 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.866194 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.866960 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.867812 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.868201 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.868294 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.870873 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.870882 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.870895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.870919 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.872637 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.873093 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.873099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.873100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.873181 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.873516 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.873520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.873521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.873763 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.873994 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.874160 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.874314 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":159,"threads_started":1}
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[18131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:34.886893 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:34.877341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53570 (local address 127.11.225.126:35657)
0811 14:58:34.877527 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:34.877531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:34.877546 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:34.877613 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:34.877615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:34.877655 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:34.877721 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:34.878303 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.878820 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.879662 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:34.879871 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:34.879952 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:34.883020 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:34.883026 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:34.883030 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:34.883058 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:34.884837 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.885329 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.885334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.885339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.885447 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:34.885817 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:34.885820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:34.885822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:34.886090 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:34.886234 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:34.886541 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 14:58:34.886677 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 14:58:34.888033 18209 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53570
I20260811 14:58:34.888787 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18325
I20260811 14:58:34.902792 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18567
I20260811 14:58:34.915560 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18781
I20260811 14:58:34.934350 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18157
2026-08-11T14:58:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2445 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[19022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[19022](info): set up 2 sockets
Aug 11 14:58:34 dist-test-slave-8hhm krb5kdc[19022](info): commencing operation
krb5kdc: starting...
W20260811 14:58:36.226778 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:36 dist-test-slave-8hhm krb5kdc[19022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:36.356340 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:39295
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:39295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:36.469430 19045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:36.469743 19045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:36.469818 19045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:36.473850 19045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:36.473939 19045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:36.473978 19045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:36.474038 19045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:36.474092 19045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:36.479141 19045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:39295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:39295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:36.480224 19045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:36.481267 19045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:36.489452 19059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:36.489528 19055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:36.489516 19062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:36.489813 19045 server_base.cc:1034] running on GCE node
I20260811 14:58:36.490500 19045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:36.491568 19045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:36.492813 19045 hybrid_clock.cc:648] HybridClock initialized: now 1786460316492782 us; error 46 us; skew 500 ppm
Aug 11 14:58:36 dist-test-slave-8hhm krb5kdc[19022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460316, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:36.499361 19045 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:36.500121 19045 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:36.500216 19045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:36.500476 19045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:36.502669 19045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "e1d0e025267040029e0975d6b8b7804e"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "cf965febd62086262685fdfc52e25f21"
server_key_iv: "885703a49a3f39809e68dd6557e22b72"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.503247 19045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "e1d0e025267040029e0975d6b8b7804e"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "cf965febd62086262685fdfc52e25f21"
server_key_iv: "885703a49a3f39809e68dd6557e22b72"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.507100 19045 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:36.509651 19071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:36.510890 19045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:36.511059 19045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "e1d0e025267040029e0975d6b8b7804e"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "cf965febd62086262685fdfc52e25f21"
server_key_iv: "885703a49a3f39809e68dd6557e22b72"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.511188 19045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:36.526751 19045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:36.529904 19045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:36.530113 19045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:36.537122 19045 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:39295
I20260811 14:58:36.537454 19167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:39295 every 8 connection(s)
I20260811 14:58:36.537825 19045 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:36.540622 19169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:36.543010 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19045
I20260811 14:58:36.543196 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:36.543464 12165 external_mini_cluster.cc:1428] Setting key e5bc75c1fc0aac0c0cafd7d678c8750b
I20260811 14:58:36.546753 19169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: Bootstrap starting.
I20260811 14:58:36.549000 19169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:36.549908 19169 log.cc:824] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:36.552239 19169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: No bootstrap required, opened a new log
Aug 11 14:58:36 dist-test-slave-8hhm krb5kdc[19022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:36.557117 19169 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } }
I20260811 14:58:36.557446 19169 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:36.557520 19169 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1d0e025267040029e0975d6b8b7804e, State: Initialized, Role: FOLLOWER
I20260811 14:58:36.557986 19169 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } }
I20260811 14:58:36.558139 19169 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:36.558161 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:36.544824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58602 (local address 127.11.225.126:39295)
0811 14:58:36.545324 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:36.545340 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:36.545378 (+ 38us) server_negotiation.cc:407] Connection header received
0811 14:58:36.546016 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:36.546033 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:36.546353 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:36.546700 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:36.547543 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.548517 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.549480 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.549946 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.550126 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:36.552878 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:36.552884 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:36.552899 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:36.552929 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:36.555027 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:36.555472 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:36.555478 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:36.555484 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:36.555627 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:36.555904 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:36.555907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:36.555909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:36.556408 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:36.556607 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:36.556835 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 14:58:36.557113 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":134,"threads_started":1}
I20260811 14:58:36.558238 19169 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:36.558326 19169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:36.559336 19169 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } }
I20260811 14:58:36.559705 19169 leader_election.cc:302] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1d0e025267040029e0975d6b8b7804e; no voters:
I20260811 14:58:36.560031 19169 leader_election.cc:288] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:36.560146 19177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:36.560372 19177 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [term 1 LEADER]: Becoming Leader. State: Replica: e1d0e025267040029e0975d6b8b7804e, State: Running, Role: LEADER
I20260811 14:58:36.560762 19177 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } }
I20260811 14:58:36.561326 19169 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:36.562498 19181 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1d0e025267040029e0975d6b8b7804e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } } }
I20260811 14:58:36.562644 19181 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:36.562992 19178 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1d0e025267040029e0975d6b8b7804e. Latest consensus state: current_term: 1 leader_uuid: "e1d0e025267040029e0975d6b8b7804e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1d0e025267040029e0975d6b8b7804e" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39295 } } }
I20260811 14:58:36.563139 19178 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:36.563057 19195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:36.566377 19195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:36.572124 19195 catalog_manager.cc:1347] Generated new cluster ID: e33b22f0bc534b848614407471989d14
I20260811 14:58:36.572201 19195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:36.606178 19195 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:36.607204 19195 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:36.612676 19195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: Generated new TSK 0
I20260811 14:58:36.613520 19195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:36.651575 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:36.767633 19216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:36.767894 19216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:36.767940 19216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:36.771967 19216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:36.772032 19216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:36.772130 19216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:36.778043 19216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:36.779114 19216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:36.780365 19216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:36.797425 19223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:36.797457 19222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:36.797484 19226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:36.797761 19216 server_base.cc:1034] running on GCE node
I20260811 14:58:36.798353 19216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:36.799009 19216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:36.800236 19216 hybrid_clock.cc:648] HybridClock initialized: now 1786460316800218 us; error 42 us; skew 500 ppm
Aug 11 14:58:36 dist-test-slave-8hhm krb5kdc[19022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460316, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:36.803239 19216 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:36.804011 19216 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:36.804116 19216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:36.804363 19216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:36.806545 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "51bbf3e9b30249e589bceab135804bfe"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "f53f64d3b8029419f40b9898a09b3c4c"
server_key_iv: "3bc1667734909898e2b203538d97ff73"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.807142 19216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "51bbf3e9b30249e589bceab135804bfe"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "f53f64d3b8029419f40b9898a09b3c4c"
server_key_iv: "3bc1667734909898e2b203538d97ff73"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.810931 19216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:36.813452 19238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:36.814970 19216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:36.815151 19216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "51bbf3e9b30249e589bceab135804bfe"
format_stamp: "Formatted at 2026-08-11 14:58:36 on dist-test-slave-8hhm"
server_key: "f53f64d3b8029419f40b9898a09b3c4c"
server_key_iv: "3bc1667734909898e2b203538d97ff73"
server_key_version: "encryptionkey@0"
I20260811 14:58:36.815285 19216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:36.855422 19216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:36.859491 19216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:36.859762 19216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:36.860463 19216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:36.861526 19216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:36.861610 19216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:36.861693 19216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:36.861745 19216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:36.872932 19216 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:35749
I20260811 14:58:36.872949 19446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:35749 every 8 connection(s)
I20260811 14:58:36.873684 19216 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:36.878742 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19216
I20260811 14:58:36.878911 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:36.879268 12165 external_mini_cluster.cc:1428] Setting key df154ef99228be33de21b2b28ab11666
Aug 11 14:58:36 dist-test-slave-8hhm krb5kdc[19022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460316, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:36.891779 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:36.875659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:57935 (local address 127.11.225.126:39295)
0811 14:58:36.875840 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:36.875844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:36.876808 (+ 964us) server_negotiation.cc:407] Connection header received
0811 14:58:36.878213 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:36.878216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:36.878277 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:36.878385 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:36.879782 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.880409 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.882362 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.882801 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.882931 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:36.886523 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:36.886530 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:36.886536 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:36.886572 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:36.888905 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:36.889646 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:36.889651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:36.889654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:36.889755 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:36.890245 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:36.890250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:36.890252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:36.890523 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:36.890618 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:36.891353 (+ 735us) server_negotiation.cc:299] Negotiation successful
0811 14:58:36.891533 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:36.893267 19454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:36.876163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:39295 (local address 127.11.225.65:57935)
0811 14:58:36.876649 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:36.876693 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:36.877995 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:36.878574 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:36.878582 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:36.879070 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:36.879629 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:36.879644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.880572 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.880576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:36.882203 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:36.882222 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:36.882998 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:36.883007 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:36.883293 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:36.884104 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:36.884124 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:36.886315 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:36.889073 (+ 2758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:36.889081 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:36.889101 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:36.889515 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:36.889870 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:36.889873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:36.889875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:36.890109 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:36.890697 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:36.890706 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:36.891034 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 14:58:36.892003 (+ 969us) client_negotiation.cc:240] Negotiation successful
0811 14:58:36.892383 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":128,"threads_started":1}
I20260811 14:58:36.894596 19449 heartbeater.cc:347] Connected to a master server at 127.11.225.126:39295
I20260811 14:58:36.894815 19449 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:36.895370 19449 heartbeater.cc:511] Master 127.11.225.126:39295 requested a full tablet report, sending...
I20260811 14:58:36.897166 19099 ts_manager.cc:194] Registered new tserver with Master: 51bbf3e9b30249e589bceab135804bfe (127.11.225.65:35749)
I20260811 14:58:36.899077 19099 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:57935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:36.915778 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:37.027746 19457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:37.027977 19457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:37.028019 19457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:37.032029 19457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:37.032116 19457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:37.032193 19457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:37.037142 19457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:37.038024 19457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:37.038923 19457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:37.048235 19467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.048235 19464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.048290 19470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:37.048574 19457 server_base.cc:1034] running on GCE node
I20260811 14:58:37.048935 19457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:37.049609 19457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:37.050799 19457 hybrid_clock.cc:648] HybridClock initialized: now 1786460317050766 us; error 42 us; skew 500 ppm
Aug 11 14:58:37 dist-test-slave-8hhm krb5kdc[19022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460317, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:37.053742 19457 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:37.054527 19457 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:37.054625 19457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:37.054872 19457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:37.056921 19457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "2b9756492a524f31ac56e3e426f0ad55"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "27aaa8c1c151ffd1e145a5deecd09cbf"
server_key_iv: "cbfd017b5f963351fe8e8c5091935fce"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.057595 19457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "2b9756492a524f31ac56e3e426f0ad55"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "27aaa8c1c151ffd1e145a5deecd09cbf"
server_key_iv: "cbfd017b5f963351fe8e8c5091935fce"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.061457 19457 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 14:58:37.064116 19479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.065415 19457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:37.065568 19457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "2b9756492a524f31ac56e3e426f0ad55"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "27aaa8c1c151ffd1e145a5deecd09cbf"
server_key_iv: "cbfd017b5f963351fe8e8c5091935fce"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.065681 19457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:37.076053 19457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:37.079085 19457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:37.079278 19457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:37.079843 19457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:37.080670 19457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:37.080744 19457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.080814 19457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:37.080865 19457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.090190 19457 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:40269
I20260811 14:58:37.090215 19665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:40269 every 8 connection(s)
I20260811 14:58:37.090816 19457 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:37.092476 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19457
I20260811 14:58:37.092633 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:37.092971 12165 external_mini_cluster.cc:1428] Setting key 0d8082ebeb7bd5fbcb6f8ff4c6fab695
Aug 11 14:58:37 dist-test-slave-8hhm krb5kdc[19022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460317, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:37.107884 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.092663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:50071 (local address 127.11.225.126:39295)
0811 14:58:37.092791 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.092796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.093917 (+ 1121us) server_negotiation.cc:407] Connection header received
0811 14:58:37.095791 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.095794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.095856 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.095928 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:37.097688 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.098560 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.100664 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.100927 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.101050 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.104236 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:37.104240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:37.104242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:37.104264 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:37.105763 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.106355 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.106358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.106360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.106435 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.106784 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.106787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.106789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.106969 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:37.107081 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.107582 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.107714 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:37.108651 19670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.093094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:39295 (local address 127.11.225.66:50071)
0811 14:58:37.093715 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.093791 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.095536 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.096148 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.096161 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.096768 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:37.097530 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.097547 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.098708 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.098711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.100491 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.100509 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.101132 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.101140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.101433 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.102097 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:37.102129 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:37.104003 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:37.105901 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:37.105907 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:37.105920 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:37.106240 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:37.106531 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:37.106535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:37.106537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:37.106679 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:37.107082 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:37.107090 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:37.107332 (+ 242us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.107512 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.107818 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":171,"threads_started":1}
I20260811 14:58:37.110080 19668 heartbeater.cc:347] Connected to a master server at 127.11.225.126:39295
I20260811 14:58:37.110337 19668 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:37.110942 19668 heartbeater.cc:511] Master 127.11.225.126:39295 requested a full tablet report, sending...
I20260811 14:58:37.112102 19099 ts_manager.cc:194] Registered new tserver with Master: 2b9756492a524f31ac56e3e426f0ad55 (127.11.225.66:40269)
I20260811 14:58:37.112691 19099 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:50071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:37.124173 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:37.236205 19673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:37.236456 19673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:37.236521 19673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:37.240443 19673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:37.240501 19673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:37.240556 19673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:37.246840 19673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:37.247781 19673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:37.248716 19673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:58:37.258386 19673 server_base.cc:1034] running on GCE node
W20260811 14:58:37.258347 19683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.258337 19687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.258350 19684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:37.259052 19673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:37.259727 19673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:37.260958 19673 hybrid_clock.cc:648] HybridClock initialized: now 1786460317260921 us; error 44 us; skew 500 ppm
Aug 11 14:58:37 dist-test-slave-8hhm krb5kdc[19022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460317, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:37.264216 19673 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:37.264957 19673 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:37.265072 19673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:37.265385 19673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:37.267436 19673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "2284697f540a4cce8f7d43865d038962"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "12d6afc9cbcda02979377a14751b911f"
server_key_iv: "e1acfebc42f285e7e44f59ceaaea78fd"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.268025 19673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "2284697f540a4cce8f7d43865d038962"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "12d6afc9cbcda02979377a14751b911f"
server_key_iv: "e1acfebc42f285e7e44f59ceaaea78fd"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.271898 19673 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 14:58:37.274432 19694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.275722 19673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:37.275873 19673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "2284697f540a4cce8f7d43865d038962"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "12d6afc9cbcda02979377a14751b911f"
server_key_iv: "e1acfebc42f285e7e44f59ceaaea78fd"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.275990 19673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:37.300237 19673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:37.304266 19673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:37.304481 19673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:37.305104 19673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:37.305994 19673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:37.306066 19673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.306140 19673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:37.306193 19673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.315618 19673 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:39541
I20260811 14:58:37.315655 19895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:39541 every 8 connection(s)
I20260811 14:58:37.316243 19673 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:37.320729 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19673
I20260811 14:58:37.320869 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:37.321156 12165 external_mini_cluster.cc:1428] Setting key 38fc85e3e1e78a03531d503e5f31bb35
Aug 11 14:58:37 dist-test-slave-8hhm krb5kdc[19022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460317, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:37.330096 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.318006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:59917 (local address 127.11.225.126:39295)
0811 14:58:37.318189 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.318194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.319018 (+ 824us) server_negotiation.cc:407] Connection header received
0811 14:58:37.320421 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.320425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.320484 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.320616 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:37.322049 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.322683 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.323829 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.324051 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.324166 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.326656 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:37.326660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:37.326662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:37.326684 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:37.327977 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.328485 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.328489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.328491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.328574 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.328931 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.328934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.328936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.329121 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:37.329263 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.329807 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.329928 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 14:58:37.331007 19899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.318405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:39295 (local address 127.11.225.67:59917)
0811 14:58:37.318872 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.318914 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.320204 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.320790 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.320797 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.321296 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:37.321900 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.321916 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.322815 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.322818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.323698 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.323708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.324208 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.324212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.324385 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.324983 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:37.324999 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:37.326486 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:37.328105 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:37.328111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:37.328126 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:37.328378 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:37.328676 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:37.328679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:37.328681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:37.328822 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:37.329250 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:37.329256 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:37.329573 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.329763 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.330070 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":111,"threads_started":1}
I20260811 14:58:37.332168 19896 heartbeater.cc:347] Connected to a master server at 127.11.225.126:39295
I20260811 14:58:37.332440 19896 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:37.332916 19896 heartbeater.cc:511] Master 127.11.225.126:39295 requested a full tablet report, sending...
I20260811 14:58:37.334152 19098 ts_manager.cc:194] Registered new tserver with Master: 2284697f540a4cce8f7d43865d038962 (127.11.225.67:39541)
I20260811 14:58:37.334762 19098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:59917
I20260811 14:58:37.334908 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:37.344390 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.336949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.11.225.126:39295)
0811 14:58:37.337120 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.337124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.337366 (+ 242us) server_negotiation.cc:407] Connection header received
0811 14:58:37.337501 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.337504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.337543 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.337603 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:37.338490 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.338977 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.339844 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.340096 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.340171 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.341535 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:37.341538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:37.341539 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:37.341560 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:37.342799 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.343222 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.343225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.343226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.343303 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:37.343566 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:37.343568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:37.343569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:37.343764 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:37.343872 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.344066 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.344155 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 14:58:37.347298 19098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:37.350284 19098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:37.365083 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.358352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35749 (local address 127.0.0.1:47512)
0811 14:58:37.359027 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.359090 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.359215 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.360331 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.360334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.360363 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:37.360468 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.360475 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.361849 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.361852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.363140 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.363150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364341 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.364373 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.364548 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.364636 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.364760 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.364914 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":52,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260811 14:58:37.365581 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.359166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.11.225.66:40269)
0811 14:58:37.359593 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.359605 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.359741 (+ 136us) server_negotiation.cc:407] Connection header received
0811 14:58:37.359929 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.359936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.360135 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.360308 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:37.360701 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.361926 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.363750 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364553 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.364656 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.364803 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.365339 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.365438 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":102,"threads_started":1}
I20260811 14:58:37.365651 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.358542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47512 (local address 127.11.225.65:35749)
0811 14:58:37.359941 (+ 1399us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.359947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.359968 (+ 21us) server_negotiation.cc:407] Connection header received
0811 14:58:37.360031 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.360035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.360180 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.360616 (+ 436us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:37.360788 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.361667 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.363267 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364155 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.365183 (+ 1028us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.365385 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.365429 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.365509 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1301,"thread_start_us":128,"threads_started":1}
I20260811 14:58:37.365849 19918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.358636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:40269 (local address 127.0.0.1:40518)
0811 14:58:37.359622 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.359637 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.359769 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.360466 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.360469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.360483 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:37.360586 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.360592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.362076 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.362079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.363632 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.363643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364861 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.364864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.364952 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.364972 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.365037 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.365095 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"mutex_wait_us":176,"thread_start_us":105,"threads_started":1}
I20260811 14:58:37.366178 19921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.359177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39482 (local address 127.11.225.67:39541)
0811 14:58:37.359550 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.359563 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.359816 (+ 253us) server_negotiation.cc:407] Connection header received
0811 14:58:37.359954 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.359958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.360128 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.360292 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:37.360600 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.361914 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.363739 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364659 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.364764 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.364921 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.365908 (+ 987us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.366028 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":162,"threads_started":1}
I20260811 14:58:37.366490 19919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.358725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:39541 (local address 127.0.0.1:39482)
0811 14:58:37.359697 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.359710 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.359839 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.360283 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.360289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.360310 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:37.360481 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.360488 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.362076 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.362079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.363591 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.363603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.364989 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.364993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.365098 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.365133 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.365558 (+ 425us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.366360 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":185,"spinlock_wait_cycles":2304,"thread_start_us":81,"threads_started":1}
I20260811 14:58:37.368600 19556 tablet_service.cc:1467] Processing CreateTablet for tablet 1473fede1aa943a09469d080108f9417 (DEFAULT_TABLE table=test-table [id=6f45b7fa930c425290fe7d83142af31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:37.368700 19321 tablet_service.cc:1467] Processing CreateTablet for tablet 1473fede1aa943a09469d080108f9417 (DEFAULT_TABLE table=test-table [id=6f45b7fa930c425290fe7d83142af31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:37.369076 19780 tablet_service.cc:1467] Processing CreateTablet for tablet 1473fede1aa943a09469d080108f9417 (DEFAULT_TABLE table=test-table [id=6f45b7fa930c425290fe7d83142af31c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:37.369737 19556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1473fede1aa943a09469d080108f9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:37.369783 19321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1473fede1aa943a09469d080108f9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:37.369997 19780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1473fede1aa943a09469d080108f9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:37.375887 19922 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Bootstrap starting.
I20260811 14:58:37.377556 19924 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: Bootstrap starting.
I20260811 14:58:37.378268 19922 tablet_bootstrap.cc:654] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:37.379429 19922 log.cc:824] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:37.379643 19924 tablet_bootstrap.cc:654] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:37.380165 19923 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Bootstrap starting.
I20260811 14:58:37.380805 19924 log.cc:824] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:37.381625 19922 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: No bootstrap required, opened a new log
I20260811 14:58:37.381832 19922 ts_tablet_manager.cc:1397] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 14:58:37.382158 19923 tablet_bootstrap.cc:654] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:37.382808 19924 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: No bootstrap required, opened a new log
I20260811 14:58:37.382978 19924 ts_tablet_manager.cc:1397] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 14:58:37.383263 19923 log.cc:824] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:37.385025 19923 tablet_bootstrap.cc:492] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: No bootstrap required, opened a new log
I20260811 14:58:37.385246 19923 ts_tablet_manager.cc:1397] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 14:58:37.385816 19922 raft_consensus.cc:348] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.386108 19922 raft_consensus.cc:374] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:37.386166 19922 raft_consensus.cc:729] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9756492a524f31ac56e3e426f0ad55, State: Initialized, Role: FOLLOWER
I20260811 14:58:37.386610 19922 consensus_queue.cc:260] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.386766 19924 raft_consensus.cc:348] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.387017 19924 raft_consensus.cc:374] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:37.387084 19924 raft_consensus.cc:729] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51bbf3e9b30249e589bceab135804bfe, State: Initialized, Role: FOLLOWER
I20260811 14:58:37.387502 19668 heartbeater.cc:503] Master 127.11.225.126:39295 was elected leader, sending a full tablet report...
I20260811 14:58:37.387506 19924 consensus_queue.cc:260] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.387744 19922 ts_tablet_manager.cc:1428] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:58:37.388302 19924 ts_tablet_manager.cc:1428] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 14:58:37.388621 19449 heartbeater.cc:503] Master 127.11.225.126:39295 was elected leader, sending a full tablet report...
I20260811 14:58:37.388657 19923 raft_consensus.cc:348] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.388919 19923 raft_consensus.cc:374] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:37.388981 19923 raft_consensus.cc:729] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2284697f540a4cce8f7d43865d038962, State: Initialized, Role: FOLLOWER
I20260811 14:58:37.389392 19923 consensus_queue.cc:260] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.390523 19923 ts_tablet_manager.cc:1428] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 14:58:37.390671 19896 heartbeater.cc:503] Master 127.11.225.126:39295 was elected leader, sending a full tablet report...
I20260811 14:58:37.421870 19934 raft_consensus.cc:482] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:37.422127 19934 raft_consensus.cc:504] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.423439 19934 leader_election.cc:288] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b9756492a524f31ac56e3e426f0ad55 (127.11.225.66:40269), 2284697f540a4cce8f7d43865d038962 (127.11.225.67:39541)
I20260811 14:58:37.427412 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.423796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36085 (local address 127.11.225.66:40269)
0811 14:58:37.423993 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.423999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.424099 (+ 100us) server_negotiation.cc:407] Connection header received
0811 14:58:37.424266 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.424270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.424320 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.424405 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:37.424705 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.425249 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426373 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.426797 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426974 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.427034 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.427203 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.427275 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 14:58:37.427424 19921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.423798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:42659 (local address 127.11.225.67:39541)
0811 14:58:37.423975 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.423980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.424193 (+ 213us) server_negotiation.cc:407] Connection header received
0811 14:58:37.424344 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.424349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.424394 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.424477 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:37.424783 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.425334 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426405 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.426806 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426985 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.427040 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.427232 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.427298 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 14:58:37.427440 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.423674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:39541 (local address 127.11.225.65:42659)
0811 14:58:37.424102 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.424113 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.424234 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.424491 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.424493 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.424510 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:37.424674 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.424680 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.425442 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.425447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.426277 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.426287 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.426976 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.427102 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.427125 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.427214 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.427284 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":51,"thread_start_us":116,"threads_started":1}
I20260811 14:58:37.427449 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.423669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:40269 (local address 127.11.225.65:36085)
0811 14:58:37.423979 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.423995 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:37.424148 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:37.424421 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:37.424424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:37.424441 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:37.424585 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.424591 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.425372 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.425376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.426241 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:37.426251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.426943 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.426947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:37.427059 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.427084 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 14:58:37.427186 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 14:58:37.427258 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":28,"thread_start_us":84,"threads_started":1}
I20260811 14:58:37.428073 19816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1473fede1aa943a09469d080108f9417" candidate_uuid: "51bbf3e9b30249e589bceab135804bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2284697f540a4cce8f7d43865d038962" is_pre_election: true
I20260811 14:58:37.428298 19598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1473fede1aa943a09469d080108f9417" candidate_uuid: "51bbf3e9b30249e589bceab135804bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9756492a524f31ac56e3e426f0ad55" is_pre_election: true
I20260811 14:58:37.428390 19816 raft_consensus.cc:2454] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51bbf3e9b30249e589bceab135804bfe in term 0.
I20260811 14:58:37.428607 19598 raft_consensus.cc:2454] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51bbf3e9b30249e589bceab135804bfe in term 0.
I20260811 14:58:37.428910 19242 leader_election.cc:302] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2284697f540a4cce8f7d43865d038962, 51bbf3e9b30249e589bceab135804bfe; no voters:
I20260811 14:58:37.429164 19934 raft_consensus.cc:2781] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:37.429275 19934 raft_consensus.cc:482] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:37.429332 19934 raft_consensus.cc:3037] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:37.430363 19934 raft_consensus.cc:504] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.430711 19934 leader_election.cc:288] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [CANDIDATE]: Term 1 election: Requested vote from peers 2b9756492a524f31ac56e3e426f0ad55 (127.11.225.66:40269), 2284697f540a4cce8f7d43865d038962 (127.11.225.67:39541)
I20260811 14:58:37.431078 19816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1473fede1aa943a09469d080108f9417" candidate_uuid: "51bbf3e9b30249e589bceab135804bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2284697f540a4cce8f7d43865d038962"
I20260811 14:58:37.431162 19598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1473fede1aa943a09469d080108f9417" candidate_uuid: "51bbf3e9b30249e589bceab135804bfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9756492a524f31ac56e3e426f0ad55"
I20260811 14:58:37.431228 19816 raft_consensus.cc:3037] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:37.431314 19598 raft_consensus.cc:3037] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:37.432440 19816 raft_consensus.cc:2454] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51bbf3e9b30249e589bceab135804bfe in term 1.
I20260811 14:58:37.432523 19598 raft_consensus.cc:2454] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51bbf3e9b30249e589bceab135804bfe in term 1.
I20260811 14:58:37.432763 19242 leader_election.cc:302] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2284697f540a4cce8f7d43865d038962, 51bbf3e9b30249e589bceab135804bfe; no voters:
I20260811 14:58:37.432928 19934 raft_consensus.cc:2781] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:37.433187 19934 raft_consensus.cc:686] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 1 LEADER]: Becoming Leader. State: Replica: 51bbf3e9b30249e589bceab135804bfe, State: Running, Role: LEADER
I20260811 14:58:37.433564 19934 consensus_queue.cc:237] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } }
I20260811 14:58:37.436899 19096 catalog_manager.cc:5495] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 51bbf3e9b30249e589bceab135804bfe (127.11.225.65). New cstate: current_term: 1 leader_uuid: "51bbf3e9b30249e589bceab135804bfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51bbf3e9b30249e589bceab135804bfe" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:37.466009 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.462502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.11.225.65:35749)
0811 14:58:37.462655 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.462658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.462674 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:58:37.462750 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.462752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.462806 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.462929 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:37.463190 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.463815 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.464636 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:37.464840 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:37.464917 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:37.465251 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:37.465687 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:37.465781 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.465848 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.465897 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 14:58:37.472070 19598 raft_consensus.cc:1261] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 1 FOLLOWER]: Refusing update from remote peer 51bbf3e9b30249e589bceab135804bfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:37.472069 19816 raft_consensus.cc:1261] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 1 FOLLOWER]: Refusing update from remote peer 51bbf3e9b30249e589bceab135804bfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:37.472790 19934 consensus_queue.cc:1035] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b9756492a524f31ac56e3e426f0ad55" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:37.473067 19939 consensus_queue.cc:1035] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2284697f540a4cce8f7d43865d038962" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 39541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:37.480870 19943 mvcc.cc:205] Tried to move back new op lower bound from 7317341460358418432 to 7317341460210384896. Current Snapshot: MvccSnapshot[applied={T|T < 7317341460358418432}]
I20260811 14:58:37.481529 19945 mvcc.cc:205] Tried to move back new op lower bound from 7317341460358418432 to 7317341460210384896. Current Snapshot: MvccSnapshot[applied={T|T < 7317341460358418432}]
I20260811 14:58:37.482868 19944 mvcc.cc:205] Tried to move back new op lower bound from 7317341460358418432 to 7317341460210384896. Current Snapshot: MvccSnapshot[applied={T|T < 7317341460358418432}]
I20260811 14:58:37.490993 19099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:37.491153 19099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:37.493745 19099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1d0e025267040029e0975d6b8b7804e: Sending DeleteTablet for 3 replicas of tablet 1473fede1aa943a09469d080108f9417
I20260811 14:58:37.494515 19321 tablet_service.cc:1514] Processing DeleteTablet for tablet 1473fede1aa943a09469d080108f9417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:37 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:47512
I20260811 14:58:37.494578 19556 tablet_service.cc:1514] Processing DeleteTablet for tablet 1473fede1aa943a09469d080108f9417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:37 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:40518
I20260811 14:58:37.495061 19956 tablet_replica.cc:330] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe: stopping tablet replica
I20260811 14:58:37.495100 19780 tablet_service.cc:1514] Processing DeleteTablet for tablet 1473fede1aa943a09469d080108f9417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:37 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:39482
I20260811 14:58:37.495510 19957 tablet_replica.cc:330] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: stopping tablet replica
I20260811 14:58:37.495700 19956 raft_consensus.cc:2229] T 1473fede1aa943a09469d080108f9417 P 51bbf3e9b30249e589bceab135804bfe [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:37.495813 19957 raft_consensus.cc:2229] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:37.495863 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19216
I20260811 14:58:37.496168 19957 raft_consensus.cc:2258] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:37.500315 19957 ts_tablet_manager.cc:1905] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:37.502576 19960 tablet_replica.cc:330] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: stopping tablet replica
I20260811 14:58:37.502995 19960 raft_consensus.cc:2229] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:37.503412 19960 raft_consensus.cc:2258] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:37.504518 19957 ts_tablet_manager.cc:1918] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:37.504670 19957 log.cc:1196] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/1473fede1aa943a09469d080108f9417
I20260811 14:58:37.505046 19957 ts_tablet_manager.cc:1939] T 1473fede1aa943a09469d080108f9417 P 2b9756492a524f31ac56e3e426f0ad55: Deleting consensus metadata
I20260811 14:58:37.506701 19079 catalog_manager.cc:4841] TS 2b9756492a524f31ac56e3e426f0ad55 (127.11.225.66:40269): tablet 1473fede1aa943a09469d080108f9417 (table test-table [id=6f45b7fa930c425290fe7d83142af31c]) successfully deleted
I20260811 14:58:37.507961 19960 ts_tablet_manager.cc:1905] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:37.511431 19960 ts_tablet_manager.cc:1918] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:37.511567 19960 log.cc:1196] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/1473fede1aa943a09469d080108f9417
I20260811 14:58:37.511934 19960 ts_tablet_manager.cc:1939] T 1473fede1aa943a09469d080108f9417 P 2284697f540a4cce8f7d43865d038962: Deleting consensus metadata
I20260811 14:58:37.513252 19076 catalog_manager.cc:4841] TS 2284697f540a4cce8f7d43865d038962 (127.11.225.67:39541): tablet 1473fede1aa943a09469d080108f9417 (table test-table [id=6f45b7fa930c425290fe7d83142af31c]) successfully deleted
W20260811 14:58:37.514423 19072 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:35749 (error 108)
I20260811 14:58:37.514626 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19457
I20260811 14:58:37.526803 19919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.526500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35749 (local address 127.0.0.1:47534)
0811 14:58:37.526644 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:37.526720 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 14:58:37.527030 19072 catalog_manager.cc:4584] TS 51bbf3e9b30249e589bceab135804bfe (127.11.225.65:35749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1473fede1aa943a09469d080108f9417: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35749: connect: Connection refused (error 111)
I20260811 14:58:37.532289 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19673
I20260811 14:58:37.547813 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19045
2026-08-11T14:58:37Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2612 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T14:58:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:37Z Disabled control of system clock
I20260811 14:58:37.584903 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40589
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:40589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:58:37.700385 19974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:37.700662 19974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:37.700701 19974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:37.704668 19974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:37.704730 19974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:37.704749 19974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:37.704768 19974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:37.704787 19974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:37.709719 19974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:40589
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:37.710747 19974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:37.712103 19974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:37.720340 19989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.720353 19981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:37.720415 19974 server_base.cc:1034] running on GCE node
W20260811 14:58:37.720359 19987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:37.721170 19974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:37.722224 19974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:37.723392 19974 hybrid_clock.cc:648] HybridClock initialized: now 1786460317723356 us; error 46 us; skew 500 ppm
I20260811 14:58:37.725481 19974 webserver.cc:460] Webserver started at http://127.11.225.126:45659/ using document root <none> and password file <none>
I20260811 14:58:37.726128 19974 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:37.726198 19974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:37.726428 19974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:37.728474 19974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "b7c2d2c2ae3a40c8ac77a830f978e311"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "a4db9d299b2ae41cad2007622c194eaf"
server_key_iv: "7453e6ef35bd0d60ab2326a8fa81615c"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.729063 19974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "b7c2d2c2ae3a40c8ac77a830f978e311"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "a4db9d299b2ae41cad2007622c194eaf"
server_key_iv: "7453e6ef35bd0d60ab2326a8fa81615c"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.733071 19974 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 14:58:37.735533 20004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.736805 19974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:37.736960 19974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "b7c2d2c2ae3a40c8ac77a830f978e311"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "a4db9d299b2ae41cad2007622c194eaf"
server_key_iv: "7453e6ef35bd0d60ab2326a8fa81615c"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.737082 19974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:37.741671 19974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:37.742254 19974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:37.742429 19974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:37.749740 19974 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:40589
I20260811 14:58:37.749807 20091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:40589 every 8 connection(s)
I20260811 14:58:37.750715 19974 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:37.754169 20096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:37.759637 20096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: Bootstrap starting.
I20260811 14:58:37.760700 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19974
I20260811 14:58:37.760833 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:37.761096 12165 external_mini_cluster.cc:1428] Setting key 8ef1b703b100ce36870a2d4806336485
I20260811 14:58:37.762450 20096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:37.763391 20096 log.cc:824] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:37.765661 20096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: No bootstrap required, opened a new log
I20260811 14:58:37.767199 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:37.762372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42442 (local address 127.11.225.126:40589)
0811 14:58:37.763153 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:37.763176 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:37.763222 (+ 46us) server_negotiation.cc:407] Connection header received
0811 14:58:37.764014 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:37.764035 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:37.764385 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:37.764768 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:37.765644 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:37.765649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:37.765663 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:37.765678 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:37.765769 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:37.765793 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:37.765905 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:37.766011 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 14:58:37.766260 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":149,"threads_started":1}
I20260811 14:58:37.770293 20096 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } }
I20260811 14:58:37.770509 20096 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:37.770555 20096 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c2d2c2ae3a40c8ac77a830f978e311, State: Initialized, Role: FOLLOWER
I20260811 14:58:37.770951 20096 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } }
I20260811 14:58:37.771133 20096 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:37.771221 20096 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:37.771332 20096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:37.772244 20096 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } }
I20260811 14:58:37.772532 20096 leader_election.cc:302] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7c2d2c2ae3a40c8ac77a830f978e311; no voters:
I20260811 14:58:37.772775 20096 leader_election.cc:288] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:37.772904 20110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:37.773181 20110 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [term 1 LEADER]: Becoming Leader. State: Replica: b7c2d2c2ae3a40c8ac77a830f978e311, State: Running, Role: LEADER
I20260811 14:58:37.773531 20110 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } }
I20260811 14:58:37.774008 20096 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:37.775224 20112 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } } }
I20260811 14:58:37.775251 20114 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7c2d2c2ae3a40c8ac77a830f978e311. Latest consensus state: current_term: 1 leader_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c2d2c2ae3a40c8ac77a830f978e311" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40589 } } }
I20260811 14:58:37.775456 20112 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:37.775492 20114 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:37.776934 20128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:37.779964 20128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:37.785392 20128 catalog_manager.cc:1347] Generated new cluster ID: 01ca2ef5727145ba85ae4adac0c541d6
I20260811 14:58:37.785459 20128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:37.797776 20128 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:37.798173 20128 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:37.806089 20128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: Generated new TSK 0
I20260811 14:58:37.806828 20128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:58:37.820189 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--builtin_ntp_servers=127.11.225.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:58:37.947278 20145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:37.947535 20145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:37.947618 20145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:37.951642 20145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:37.951717 20145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:37.951819 20145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:37.956657 20145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:37.957727 20145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:37.959142 20145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:37.969241 20157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.969306 20159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:37.969305 20153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:37.969543 20145 server_base.cc:1034] running on GCE node
I20260811 14:58:37.969949 20145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:37.970625 20145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:37.971814 20145 hybrid_clock.cc:648] HybridClock initialized: now 1786460317971795 us; error 32 us; skew 500 ppm
I20260811 14:58:37.973825 20145 webserver.cc:460] Webserver started at http://127.11.225.65:38865/ using document root <none> and password file <none>
I20260811 14:58:37.974447 20145 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:37.974541 20145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:37.974785 20145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:37.977025 20145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "d600152c84c14b488fb9b9e99248e13d"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "75566b27b72a4a177db80c87112917fe"
server_key_iv: "c2f3de69218996d722427fae271484ea"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.977643 20145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "d600152c84c14b488fb9b9e99248e13d"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "75566b27b72a4a177db80c87112917fe"
server_key_iv: "c2f3de69218996d722427fae271484ea"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.981276 20145 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 14:58:37.983778 20172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.985002 20145 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:37.985167 20145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "d600152c84c14b488fb9b9e99248e13d"
format_stamp: "Formatted at 2026-08-11 14:58:37 on dist-test-slave-8hhm"
server_key: "75566b27b72a4a177db80c87112917fe"
server_key_iv: "c2f3de69218996d722427fae271484ea"
server_key_version: "encryptionkey@0"
I20260811 14:58:37.985332 20145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:37.989851 20145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:37.990437 20145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:37.990660 20145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:37.991206 20145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:37.992120 20145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:37.992194 20145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:37.992270 20145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:37.992331 20145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.001428 20145 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:42541
I20260811 14:58:38.001511 20367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:42541 every 8 connection(s)
I20260811 14:58:38.002341 20145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:38.008543 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 20145
I20260811 14:58:38.008688 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:38.008831 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.004194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:49269 (local address 127.11.225.126:40589)
0811 14:58:38.004364 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.004370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.005541 (+ 1171us) server_negotiation.cc:407] Connection header received
0811 14:58:38.006966 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.006969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.007018 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.007105 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.008313 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.008319 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.008322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.008337 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.008362 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.008373 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.008491 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.008630 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.008683 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:58:38.009025 12165 external_mini_cluster.cc:1428] Setting key 5f7c410d9d00603d579226ad3b033dd4
I20260811 14:58:38.009865 20371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.004634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40589 (local address 127.11.225.65:49269)
0811 14:58:38.005396 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.005436 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.006746 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.007274 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.007280 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.007364 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.007979 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.007981 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.008023 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.008091 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.008477 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.008484 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.008489 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.008656 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.008913 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":131,"threads_started":1}
I20260811 14:58:38.011149 20368 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40589
I20260811 14:58:38.011297 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--builtin_ntp_servers=127.11.225.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 14:58:38.011402 20368 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:38.011813 20368 heartbeater.cc:511] Master 127.11.225.126:40589 requested a full tablet report, sending...
I20260811 14:58:38.013336 20032 ts_manager.cc:194] Registered new tserver with Master: d600152c84c14b488fb9b9e99248e13d (127.11.225.65:42541)
W20260811 14:58:38.127519 20373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:38.127779 20373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:38.127818 20373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:38.131875 20373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:38.131930 20373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:38.131986 20373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:38.136930 20373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:38.138090 20373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:38.139518 20373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:38.149068 20392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:38.149084 20383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:38.149118 20386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:38.149433 20373 server_base.cc:1034] running on GCE node
I20260811 14:58:38.149904 20373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:38.150605 20373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:38.151798 20373 hybrid_clock.cc:648] HybridClock initialized: now 1786460318151777 us; error 34 us; skew 500 ppm
I20260811 14:58:38.153712 20373 webserver.cc:460] Webserver started at http://127.11.225.66:39577/ using document root <none> and password file <none>
I20260811 14:58:38.154300 20373 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:38.154397 20373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:38.154672 20373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:38.156723 20373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "0f09f3b1d7104b2da2d2ffe29de13446"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "4e981f3db208a236f4ff07e3898251eb"
server_key_iv: "4e8e42958617467e2d045aa1d14787d4"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.157373 20373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "0f09f3b1d7104b2da2d2ffe29de13446"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "4e981f3db208a236f4ff07e3898251eb"
server_key_iv: "4e8e42958617467e2d045aa1d14787d4"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.161026 20373 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:38.163445 20402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.164659 20373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:38.164815 20373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "0f09f3b1d7104b2da2d2ffe29de13446"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "4e981f3db208a236f4ff07e3898251eb"
server_key_iv: "4e8e42958617467e2d045aa1d14787d4"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.164944 20373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:38.169452 20373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:38.169975 20373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:38.170104 20373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:38.170562 20373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:38.171358 20373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:38.171406 20373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.171442 20373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:38.171465 20373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.180564 20373 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:42245
I20260811 14:58:38.180595 20593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:42245 every 8 connection(s)
I20260811 14:58:38.181475 20373 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:38.187323 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.183256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52783 (local address 127.11.225.126:40589)
0811 14:58:38.183408 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.183413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.184508 (+ 1095us) server_negotiation.cc:407] Connection header received
0811 14:58:38.185791 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.185794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.185832 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.185906 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.186931 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.186935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.186937 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.186948 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.186966 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.186975 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.187072 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.187170 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.187207 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:38.188228 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.183717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40589 (local address 127.11.225.66:52783)
0811 14:58:38.184356 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.184394 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.185608 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.186078 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.186084 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.186168 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.186686 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.186688 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.186726 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.186792 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.187048 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.187055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.187059 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.187185 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.187405 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":115,"threads_started":1}
I20260811 14:58:38.189276 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 20373
I20260811 14:58:38.189438 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:38.189533 20594 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40589
I20260811 14:58:38.189761 12165 external_mini_cluster.cc:1428] Setting key 64b235179822881cded52dc9a3a87bc1
I20260811 14:58:38.189798 20594 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:38.190245 20594 heartbeater.cc:511] Master 127.11.225.126:40589 requested a full tablet report, sending...
I20260811 14:58:38.191293 20032 ts_manager.cc:194] Registered new tserver with Master: 0f09f3b1d7104b2da2d2ffe29de13446 (127.11.225.66:42245)
I20260811 14:58:38.191715 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--builtin_ntp_servers=127.11.225.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 14:58:38.309798 20598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:38.310048 20598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:38.310115 20598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:38.314117 20598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:38.314172 20598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:38.314257 20598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:38.319036 20598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:38.320078 20598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:38.321493 20598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:38.331017 20618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:38.331014 20613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:38.331014 20615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:38.331432 20598 server_base.cc:1034] running on GCE node
I20260811 14:58:38.331804 20598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:38.332360 20598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:38.333561 20598 hybrid_clock.cc:648] HybridClock initialized: now 1786460318333499 us; error 74 us; skew 500 ppm
I20260811 14:58:38.335578 20598 webserver.cc:460] Webserver started at http://127.11.225.67:36379/ using document root <none> and password file <none>
I20260811 14:58:38.336182 20598 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:38.336285 20598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:38.336545 20598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:38.338711 20598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "c68a2f6b077b4a0aa43e9a577bc64d72"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "b992e7ac5d76abd09140a9de357a2574"
server_key_iv: "b304467134728a18f2ecdb608f2d9882"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.339349 20598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "c68a2f6b077b4a0aa43e9a577bc64d72"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "b992e7ac5d76abd09140a9de357a2574"
server_key_iv: "b304467134728a18f2ecdb608f2d9882"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.343328 20598 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:38.346069 20627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.347244 20598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:38.347390 20598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "c68a2f6b077b4a0aa43e9a577bc64d72"
format_stamp: "Formatted at 2026-08-11 14:58:38 on dist-test-slave-8hhm"
server_key: "b992e7ac5d76abd09140a9de357a2574"
server_key_iv: "b304467134728a18f2ecdb608f2d9882"
server_key_version: "encryptionkey@0"
I20260811 14:58:38.347519 20598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:38.352227 20598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:38.352841 20598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:38.353044 20598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:38.353662 20598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:38.354625 20598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:38.354703 20598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.354779 20598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:38.354837 20598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:38.364348 20598 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:42003
I20260811 14:58:38.364367 20828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:42003 every 8 connection(s)
I20260811 14:58:38.365342 20598 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:38.368881 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 20598
I20260811 14:58:38.368999 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:38.369344 12165 external_mini_cluster.cc:1428] Setting key 93b8cd86775c81fabb6a83f41f500f5e
I20260811 14:58:38.372130 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.367181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:48711 (local address 127.11.225.126:40589)
0811 14:58:38.367323 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.367327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.368490 (+ 1163us) server_negotiation.cc:407] Connection header received
0811 14:58:38.370222 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.370226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.370273 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.370374 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.371668 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.371674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.371678 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.371704 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.371731 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.371743 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.371838 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.371987 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.372027 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 14:58:38.372969 20833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.367573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40589 (local address 127.11.225.67:48711)
0811 14:58:38.368302 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.368341 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.369984 (+ 1643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.370564 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.370575 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.370717 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.371367 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.371369 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.371408 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.371508 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.371850 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.371858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.371862 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.372000 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.372184 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":188,"threads_started":1}
I20260811 14:58:38.374127 20829 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40589
I20260811 14:58:38.374357 20829 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:38.374774 20829 heartbeater.cc:511] Master 127.11.225.126:40589 requested a full tablet report, sending...
I20260811 14:58:38.375799 20032 ts_manager.cc:194] Registered new tserver with Master: c68a2f6b077b4a0aa43e9a577bc64d72 (127.11.225.67:42003)
I20260811 14:58:38.383369 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:38.386986 20107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.385249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.11.225.126:40589)
0811 14:58:38.385348 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.385351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.385593 (+ 242us) server_negotiation.cc:407] Connection header received
0811 14:58:38.385772 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.385781 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.385815 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.385907 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.386598 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.386601 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.386604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.386616 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.386636 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.386647 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.386741 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.386815 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.386859 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 14:58:38.389902 20032 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42446:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:38.392832 20032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:38.404793 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.401964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:42541 (local address 127.0.0.1:40888)
0811 14:58:38.402392 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.402442 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.402550 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.403206 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.403209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.403275 (+ 66us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.404040 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.404042 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.404061 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.404140 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.404460 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.404469 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.404475 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.404589 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.404657 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":90,"threads_started":1}
I20260811 14:58:38.404811 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.402378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40888 (local address 127.11.225.65:42541)
0811 14:58:38.402841 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.402852 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.402875 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:58:38.402920 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.402924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.403056 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.403567 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.404276 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.404282 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.404294 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.404305 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.404350 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.404371 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.404486 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.404611 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.404682 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":115,"threads_started":1}
I20260811 14:58:38.405354 20854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.401404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:42003 (local address 127.0.0.1:42898)
0811 14:58:38.402509 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.402523 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.402615 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.403304 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.403306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.403317 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.404228 (+ 911us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.404232 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.404248 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.404282 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.404768 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.404771 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.404774 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.404829 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.405181 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"spinlock_wait_cycles":1280,"thread_start_us":134,"threads_started":1}
I20260811 14:58:38.405797 20857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.401413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56860 (local address 127.11.225.66:42245)
0811 14:58:38.402148 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.402167 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.402554 (+ 387us) server_negotiation.cc:407] Connection header received
0811 14:58:38.402784 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.402790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.402993 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.403156 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.405129 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.405135 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.405148 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.405165 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.405237 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.405274 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.405357 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.405572 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.405646 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":153,"threads_started":1}
I20260811 14:58:38.405984 20865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.401915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.11.225.67:42003)
0811 14:58:38.402862 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.402870 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.402889 (+ 19us) server_negotiation.cc:407] Connection header received
0811 14:58:38.402931 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.402935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.403162 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.403883 (+ 721us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.404560 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.404566 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.404576 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.404587 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.404629 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.404659 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.405656 (+ 997us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.405702 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.405759 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":862,"thread_start_us":182,"threads_started":1}
I20260811 14:58:38.406140 20853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.401263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:42245 (local address 127.0.0.1:56860)
0811 14:58:38.402393 (+ 1130us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.402444 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.402615 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.403181 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.403187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.403277 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.404409 (+ 1132us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.404411 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.404420 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.404439 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.405438 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.405442 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.405444 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.405959 (+ 515us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.406000 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"spinlock_wait_cycles":3840,"thread_start_us":76,"threads_started":1}
I20260811 14:58:38.407943 20255 tablet_service.cc:1467] Processing CreateTablet for tablet 1785bfca8273445180181be0db3616aa (DEFAULT_TABLE table=test-table [id=3246fab6e18043b494cd49d191edba84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:38.408574 20720 tablet_service.cc:1467] Processing CreateTablet for tablet 1785bfca8273445180181be0db3616aa (DEFAULT_TABLE table=test-table [id=3246fab6e18043b494cd49d191edba84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:38.409126 20255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1785bfca8273445180181be0db3616aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:38.409560 20720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1785bfca8273445180181be0db3616aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:38.409154 20485 tablet_service.cc:1467] Processing CreateTablet for tablet 1785bfca8273445180181be0db3616aa (DEFAULT_TABLE table=test-table [id=3246fab6e18043b494cd49d191edba84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:38.410125 20485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1785bfca8273445180181be0db3616aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:38.415586 20867 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Bootstrap starting.
I20260811 14:58:38.416781 20868 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Bootstrap starting.
I20260811 14:58:38.417351 20869 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Bootstrap starting.
I20260811 14:58:38.419003 20869 tablet_bootstrap.cc:654] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:38.419019 20868 tablet_bootstrap.cc:654] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:38.419006 20867 tablet_bootstrap.cc:654] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:38.419751 20869 log.cc:824] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:38.419878 20868 log.cc:824] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:38.419878 20867 log.cc:824] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:38.421666 20869 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: No bootstrap required, opened a new log
I20260811 14:58:38.421864 20867 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: No bootstrap required, opened a new log
I20260811 14:58:38.421864 20868 tablet_bootstrap.cc:492] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: No bootstrap required, opened a new log
I20260811 14:58:38.421880 20869 ts_tablet_manager.cc:1397] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 14:58:38.422052 20868 ts_tablet_manager.cc:1397] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260811 14:58:38.422204 20867 ts_tablet_manager.cc:1397] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260811 14:58:38.425437 20869 raft_consensus.cc:348] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.425683 20869 raft_consensus.cc:374] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:38.425746 20869 raft_consensus.cc:729] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f09f3b1d7104b2da2d2ffe29de13446, State: Initialized, Role: FOLLOWER
I20260811 14:58:38.426231 20869 consensus_queue.cc:260] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.426532 20867 raft_consensus.cc:348] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.426532 20868 raft_consensus.cc:348] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.426783 20867 raft_consensus.cc:374] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:38.426783 20868 raft_consensus.cc:374] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:38.426842 20868 raft_consensus.cc:729] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d600152c84c14b488fb9b9e99248e13d, State: Initialized, Role: FOLLOWER
I20260811 14:58:38.426842 20867 raft_consensus.cc:729] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68a2f6b077b4a0aa43e9a577bc64d72, State: Initialized, Role: FOLLOWER
I20260811 14:58:38.426990 20594 heartbeater.cc:503] Master 127.11.225.126:40589 was elected leader, sending a full tablet report...
I20260811 14:58:38.427270 20869 ts_tablet_manager.cc:1428] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 14:58:38.427253 20867 consensus_queue.cc:260] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.427254 20868 consensus_queue.cc:260] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.428145 20829 heartbeater.cc:503] Master 127.11.225.126:40589 was elected leader, sending a full tablet report...
I20260811 14:58:38.428200 20868 ts_tablet_manager.cc:1428] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260811 14:58:38.428200 20867 ts_tablet_manager.cc:1428] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 14:58:38.428491 20368 heartbeater.cc:503] Master 127.11.225.126:40589 was elected leader, sending a full tablet report...
W20260811 14:58:38.432384 20595 tablet.cc:2369] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:38.503657 20370 tablet.cc:2369] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:58:38.616384 20830 tablet.cc:2369] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:38.813427 20881 raft_consensus.cc:482] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:38.813707 20881 raft_consensus.cc:504] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.814957 20881 leader_election.cc:288] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f09f3b1d7104b2da2d2ffe29de13446 (127.11.225.66:42245), c68a2f6b077b4a0aa43e9a577bc64d72 (127.11.225.67:42003)
I20260811 14:58:38.817579 20865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.815397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:40717 (local address 127.11.225.67:42003)
0811 14:58:38.815655 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.815660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.815731 (+ 71us) server_negotiation.cc:407] Connection header received
0811 14:58:38.815893 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.815899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.815944 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.816007 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.816965 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.816971 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.816973 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.816998 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.817033 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.817045 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.817157 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.817334 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.817396 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260811 14:58:38.817591 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.815284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:42003 (local address 127.11.225.65:40717)
0811 14:58:38.815621 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.815642 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.815777 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.816073 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.816077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.816094 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.816696 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.816700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.816715 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.816765 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.817174 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.817178 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.817181 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.817322 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.817369 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":82,"threads_started":1}
I20260811 14:58:38.817878 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.815284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:42245 (local address 127.11.225.65:58729)
0811 14:58:38.815663 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.815681 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:38.815807 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:38.816148 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:38.816150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:38.816162 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:38.817023 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:58:38.817025 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:38.817036 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:58:38.817064 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:38.817429 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:38.817432 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:38.817436 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:58:38.817622 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 14:58:38.817677 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":31,"thread_start_us":65,"threads_started":1}
I20260811 14:58:38.817907 20857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.815396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:58729 (local address 127.11.225.66:42245)
0811 14:58:38.815568 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.815574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.815803 (+ 229us) server_negotiation.cc:407] Connection header received
0811 14:58:38.815924 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.815926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.815962 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.816071 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.817197 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.817201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.817205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.817249 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.817274 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.817288 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.817411 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.817650 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.817717 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 14:58:38.818559 20522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1785bfca8273445180181be0db3616aa" candidate_uuid: "d600152c84c14b488fb9b9e99248e13d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" is_pre_election: true
I20260811 14:58:38.818734 20754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1785bfca8273445180181be0db3616aa" candidate_uuid: "d600152c84c14b488fb9b9e99248e13d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" is_pre_election: true
I20260811 14:58:38.818905 20522 raft_consensus.cc:2454] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d600152c84c14b488fb9b9e99248e13d in term 0.
I20260811 14:58:38.819082 20754 raft_consensus.cc:2454] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d600152c84c14b488fb9b9e99248e13d in term 0.
I20260811 14:58:38.819442 20177 leader_election.cc:302] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f09f3b1d7104b2da2d2ffe29de13446, d600152c84c14b488fb9b9e99248e13d; no voters:
I20260811 14:58:38.819752 20881 raft_consensus.cc:2781] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:38.819857 20881 raft_consensus.cc:482] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:38.819922 20881 raft_consensus.cc:3037] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:38.821121 20881 raft_consensus.cc:504] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.821527 20881 leader_election.cc:288] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [CANDIDATE]: Term 1 election: Requested vote from peers 0f09f3b1d7104b2da2d2ffe29de13446 (127.11.225.66:42245), c68a2f6b077b4a0aa43e9a577bc64d72 (127.11.225.67:42003)
I20260811 14:58:38.821909 20754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1785bfca8273445180181be0db3616aa" candidate_uuid: "d600152c84c14b488fb9b9e99248e13d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72"
I20260811 14:58:38.821909 20522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1785bfca8273445180181be0db3616aa" candidate_uuid: "d600152c84c14b488fb9b9e99248e13d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f09f3b1d7104b2da2d2ffe29de13446"
I20260811 14:58:38.822053 20754 raft_consensus.cc:3037] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:38.822084 20522 raft_consensus.cc:3037] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:38.823463 20522 raft_consensus.cc:2454] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d600152c84c14b488fb9b9e99248e13d in term 1.
I20260811 14:58:38.823472 20754 raft_consensus.cc:2454] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d600152c84c14b488fb9b9e99248e13d in term 1.
I20260811 14:58:38.823808 20178 leader_election.cc:302] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c68a2f6b077b4a0aa43e9a577bc64d72, d600152c84c14b488fb9b9e99248e13d; no voters:
I20260811 14:58:38.824064 20881 raft_consensus.cc:2781] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:38.824298 20881 raft_consensus.cc:686] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 1 LEADER]: Becoming Leader. State: Replica: d600152c84c14b488fb9b9e99248e13d, State: Running, Role: LEADER
I20260811 14:58:38.824687 20881 consensus_queue.cc:237] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } }
I20260811 14:58:38.828202 20028 catalog_manager.cc:5495] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d reported cstate change: term changed from 0 to 1, leader changed from <none> to d600152c84c14b488fb9b9e99248e13d (127.11.225.65). New cstate: current_term: 1 leader_uuid: "d600152c84c14b488fb9b9e99248e13d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d600152c84c14b488fb9b9e99248e13d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 42541 } health_report { overall_health: HEALTHY } } }
I20260811 14:58:38.855372 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.854013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40902 (local address 127.11.225.65:42541)
0811 14:58:38.854151 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:38.854154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:38.854167 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:38.854244 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:38.854246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:38.854305 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:38.854373 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:38.854991 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:38.854994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:38.854996 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:38.855009 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:38.855029 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:38.855036 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:38.855111 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:38.855234 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 14:58:38.855270 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:38.861443 20754 raft_consensus.cc:1261] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 1 FOLLOWER]: Refusing update from remote peer d600152c84c14b488fb9b9e99248e13d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:38.861443 20522 raft_consensus.cc:1261] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 1 FOLLOWER]: Refusing update from remote peer d600152c84c14b488fb9b9e99248e13d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:38.862172 20886 consensus_queue.cc:1035] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c68a2f6b077b4a0aa43e9a577bc64d72" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:38.862397 20881 consensus_queue.cc:1035] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f09f3b1d7104b2da2d2ffe29de13446" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 42245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:38.873049 20892 mvcc.cc:205] Tried to move back new op lower bound from 7317341466049044480 to 7317341465908817920. Current Snapshot: MvccSnapshot[applied={T|T < 7317341466049044480}]
I20260811 14:58:38.873303 20891 mvcc.cc:205] Tried to move back new op lower bound from 7317341466049044480 to 7317341465908817920. Current Snapshot: MvccSnapshot[applied={T|T < 7317341466049044480 or (T in {7317341466049044480})}]
I20260811 14:58:38.878912 20028 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:38.879105 20028 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42446:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:38.881713 20028 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7c2d2c2ae3a40c8ac77a830f978e311: Sending DeleteTablet for 3 replicas of tablet 1785bfca8273445180181be0db3616aa
I20260811 14:58:38.882625 20720 tablet_service.cc:1514] Processing DeleteTablet for tablet 1785bfca8273445180181be0db3616aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:38 UTC) from {username='slave'} at 127.0.0.1:42898
I20260811 14:58:38.882771 20485 tablet_service.cc:1514] Processing DeleteTablet for tablet 1785bfca8273445180181be0db3616aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:38 UTC) from {username='slave'} at 127.0.0.1:56860
I20260811 14:58:38.883306 20255 tablet_service.cc:1514] Processing DeleteTablet for tablet 1785bfca8273445180181be0db3616aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:38 UTC) from {username='slave'} at 127.0.0.1:40888
I20260811 14:58:38.883857 20911 tablet_replica.cc:330] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: stopping tablet replica
I20260811 14:58:38.883929 20910 tablet_replica.cc:330] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: stopping tablet replica
I20260811 14:58:38.884284 20910 raft_consensus.cc:2229] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:38.884481 20911 raft_consensus.cc:2229] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:38.884619 20910 raft_consensus.cc:2258] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:38.885161 20911 raft_consensus.cc:2258] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:38.886603 20910 ts_tablet_manager.cc:1905] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:38.888849 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 20145
I20260811 14:58:38.888974 20911 ts_tablet_manager.cc:1905] T 1785bfca8273445180181be0db3616aa P d600152c84c14b488fb9b9e99248e13d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:38.890103 20910 ts_tablet_manager.cc:1918] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:38.890202 20910 log.cc:1196] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/1785bfca8273445180181be0db3616aa
I20260811 14:58:38.890475 20910 ts_tablet_manager.cc:1939] T 1785bfca8273445180181be0db3616aa P c68a2f6b077b4a0aa43e9a577bc64d72: Deleting consensus metadata
I20260811 14:58:38.891824 20014 catalog_manager.cc:4841] TS c68a2f6b077b4a0aa43e9a577bc64d72 (127.11.225.67:42003): tablet 1785bfca8273445180181be0db3616aa (table test-table [id=3246fab6e18043b494cd49d191edba84]) successfully deleted
I20260811 14:58:38.895475 20908 tablet_replica.cc:330] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: stopping tablet replica
I20260811 14:58:38.895803 20908 raft_consensus.cc:2229] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:38.896128 20908 raft_consensus.cc:2258] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:38.897460 20908 ts_tablet_manager.cc:1905] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:38.899602 20908 ts_tablet_manager.cc:1918] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:38.899744 20908 log.cc:1196] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/1785bfca8273445180181be0db3616aa
I20260811 14:58:38.900034 20908 ts_tablet_manager.cc:1939] T 1785bfca8273445180181be0db3616aa P 0f09f3b1d7104b2da2d2ffe29de13446: Deleting consensus metadata
I20260811 14:58:38.901161 20010 catalog_manager.cc:4841] TS 0f09f3b1d7104b2da2d2ffe29de13446 (127.11.225.66:42245): tablet 1785bfca8273445180181be0db3616aa (table test-table [id=3246fab6e18043b494cd49d191edba84]) successfully deleted
I20260811 14:58:38.903185 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 20373
W20260811 14:58:38.903277 20010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:42541 (error 108)
I20260811 14:58:38.912400 20915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:38.911903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:42541 (local address 127.0.0.1:40910)
0811 14:58:38.912167 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:38.912263 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:42541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":57,"threads_started":1}
W20260811 14:58:38.912590 20010 catalog_manager.cc:4584] TS d600152c84c14b488fb9b9e99248e13d (127.11.225.65:42541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1785bfca8273445180181be0db3616aa: Network error: Client connection negotiation failed: client connection to 127.11.225.65:42541: connect: Connection refused (error 111)
I20260811 14:58:38.917099 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 20598
I20260811 14:58:38.930970 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19974
2026-08-11T14:58:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1382 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 14:58:38.958523 12165 mini_oidc.cc:152] Starting JWKS server
I20260811 14:58:38.960376 12165 webserver.cc:460] Webserver started at https://127.0.0.1:34149/ using document root <none> and password file <none>
I20260811 14:58:38.960577 12165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:58:38.960901 12165 webserver.cc:460] Webserver started at http://127.0.0.1:46485/ using document root <none> and password file <none>
2026-08-11T14:58:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:38Z Disabled control of system clock
I20260811 14:58:38.971652 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35603
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:34593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:35603
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34149/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/testchainca.cert with env {}
W20260811 14:58:39.084699 20928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:39.084996 20928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:39.085040 20928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:39.089598 20928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:39.089659 20928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:39.089676 20928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:39.089694 20928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:39.089710 20928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:58:39.089728 20928 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:58:39.089743 20928 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34149/jwks.json
I20260811 14:58:39.095418 20928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:35603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34149/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:39.096431 20928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:39.097420 20928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:39.105713 20937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:39.105705 20939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:39.105701 20946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:39.106056 20928 server_base.cc:1034] running on GCE node
I20260811 14:58:39.106689 20928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:39.107800 20928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:39.109040 20928 hybrid_clock.cc:648] HybridClock initialized: now 1786460319109025 us; error 33 us; skew 500 ppm
I20260811 14:58:39.111001 20928 webserver.cc:460] Webserver started at http://127.11.225.126:39403/ using document root <none> and password file <none>
I20260811 14:58:39.111595 20928 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:39.111687 20928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:39.111933 20928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:39.114108 20928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "cd28b8d405524be7b5a18cd92edc094a"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "8b1f9dc36e983639cff92016fa7c2449"
server_key_iv: "a0e73f66af4e4cba7f0533fe52952a82"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.114709 20928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "cd28b8d405524be7b5a18cd92edc094a"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "8b1f9dc36e983639cff92016fa7c2449"
server_key_iv: "a0e73f66af4e4cba7f0533fe52952a82"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.118505 20928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:58:39.120888 20956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:39.122118 20928 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:58:39.122252 20928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "cd28b8d405524be7b5a18cd92edc094a"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "8b1f9dc36e983639cff92016fa7c2449"
server_key_iv: "a0e73f66af4e4cba7f0533fe52952a82"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.122357 20928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:39.137835 20928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:39.138554 20928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:39.138749 20928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:39.145881 20928 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:35603
I20260811 14:58:39.145885 21047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:35603 every 8 connection(s)
I20260811 14:58:39.146864 20928 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:39.147281 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 20928
I20260811 14:58:39.147414 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:39.147698 12165 external_mini_cluster.cc:1428] Setting key a135b7e944b21c13e5d30a3cd0560e63
I20260811 14:58:39.150673 21048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:39.157297 21048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a: Bootstrap starting.
I20260811 14:58:39.157687 21055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.149183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46336 (local address 127.11.225.126:35603)
0811 14:58:39.149865 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.149881 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.149917 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:39.150581 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.150599 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.151029 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.151338 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:39.151686 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.152643 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.153920 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.154749 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.154872 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.155772 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:39.155777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:39.155789 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:39.156206 (+ 417us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:39.156261 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:39.156281 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:39.156355 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:39.156528 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 14:58:39.156819 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":144,"threads_started":1}
I20260811 14:58:39.159614 21048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:39.160347 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:58:39.160356 21048 log.cc:824] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:39.162320 21048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a: No bootstrap required, opened a new log
I20260811 14:58:39.165653 21048 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } }
I20260811 14:58:39.165874 21048 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:39.165933 21048 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd28b8d405524be7b5a18cd92edc094a, State: Initialized, Role: FOLLOWER
I20260811 14:58:39.166287 21048 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } }
I20260811 14:58:39.166396 21048 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:39.166476 21048 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:39.166606 21048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:39.167560 21048 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } }
I20260811 14:58:39.167891 21048 leader_election.cc:302] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd28b8d405524be7b5a18cd92edc094a; no voters:
I20260811 14:58:39.168190 21048 leader_election.cc:288] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:39.168314 21060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:39.168555 21060 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [term 1 LEADER]: Becoming Leader. State: Replica: cd28b8d405524be7b5a18cd92edc094a, State: Running, Role: LEADER
I20260811 14:58:39.168867 21060 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } }
I20260811 14:58:39.169462 21048 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:39.170521 21061 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd28b8d405524be7b5a18cd92edc094a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } } }
I20260811 14:58:39.170670 21061 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.170974 21065 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd28b8d405524be7b5a18cd92edc094a. Latest consensus state: current_term: 1 leader_uuid: "cd28b8d405524be7b5a18cd92edc094a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd28b8d405524be7b5a18cd92edc094a" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35603 } } }
I20260811 14:58:39.171059 21076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:39.171094 21065 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.174365 21076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:39.179867 21076 catalog_manager.cc:1347] Generated new cluster ID: 33f0b90750a0418f99ddd8841f756694
I20260811 14:58:39.179929 21076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:39.196556 21076 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:39.197849 21076 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:39.203680 21076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd28b8d405524be7b5a18cd92edc094a: Generated new TSK 0
I20260811 14:58:39.204535 21076 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 14:58:39.240775 21110 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 14:58:39.240960 21110 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 14:58:39.241644 21055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.222330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46342 (local address 127.11.225.126:35603)
0811 14:58:39.222459 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.222464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.222732 (+ 268us) server_negotiation.cc:407] Connection header received
0811 14:58:39.222959 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.222963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.223045 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.223168 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:58:39.223416 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.224276 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.225268 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.225629 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.225734 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.226193 (+ 459us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:58:39.241153 (+ 14960us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 14:58:39.241472 (+ 319us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46342: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 14:58:39.241734 21055 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46342: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 14:58:39.243340 21108 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:39.222261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35603 (local address 127.0.0.1:46342)
0811 14:58:39.222643 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:39.222656 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:39.222796 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:39.223192 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:39.223195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:39.223202 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:58:39.223308 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.223314 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.224401 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.224404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.225125 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.225134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.225743 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.225746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.225816 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.225905 (+ 89us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:58:39.241439 (+ 15534us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 14:58:39.241666 (+ 227us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.225.126:35603: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":149,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.225.126:35603: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34149/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 14:58:39.244376 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 20928
2026-08-11T14:58:39Z chronyd exiting
I20260811 14:58:39.293846 12165 test_util.cc:175] -----------------------------------------------
I20260811 14:58:39.293946 12165 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460289406450-12165-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 14:58:39.295189 12165 mini_oidc.cc:152] Starting JWKS server
I20260811 14:58:39.296106 12165 webserver.cc:460] Webserver started at https://127.0.0.1:34951/ using document root <none> and password file <none>
I20260811 14:58:39.296222 12165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:58:39.296552 12165 webserver.cc:460] Webserver started at http://127.0.0.1:36043/ using document root <none> and password file <none>
2026-08-11T14:58:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:39Z Disabled control of system clock
I20260811 14:58:39.308318 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:34835
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:35621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:34835
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34951/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/testchainca.cert with env {}
W20260811 14:58:39.421900 21124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:39.422199 21124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:39.422278 21124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:39.426257 21124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:39.426332 21124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:39.426360 21124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:39.426395 21124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:39.426434 21124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:58:39.426472 21124 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:58:39.426504 21124 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34951/jwks.json
I20260811 14:58:39.431731 21124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:34835
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:34835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34951/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:39.432826 21124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:39.433899 21124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:39.442447 21130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:39.442497 21124 server_base.cc:1034] running on GCE node
W20260811 14:58:39.442490 21141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:39.442453 21133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:39.443352 21124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:39.444521 21124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:39.445731 21124 hybrid_clock.cc:648] HybridClock initialized: now 1786460319445715 us; error 25 us; skew 500 ppm
I20260811 14:58:39.447759 21124 webserver.cc:460] Webserver started at http://127.11.225.126:34517/ using document root <none> and password file <none>
I20260811 14:58:39.448421 21124 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:39.448524 21124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:39.448755 21124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:39.450855 21124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "1511a75afc5341278f196d832c3d26c2"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "7c1061305e3cab1e52984a3ce40b36dc"
server_key_iv: "686cb28f75e917d7e792fe6adf325bcd"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.451435 21124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "1511a75afc5341278f196d832c3d26c2"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "7c1061305e3cab1e52984a3ce40b36dc"
server_key_iv: "686cb28f75e917d7e792fe6adf325bcd"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.455379 21124 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 14:58:39.457913 21152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:39.459180 21124 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:39.459319 21124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "1511a75afc5341278f196d832c3d26c2"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "7c1061305e3cab1e52984a3ce40b36dc"
server_key_iv: "686cb28f75e917d7e792fe6adf325bcd"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.459432 21124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:39.474159 21124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:39.474783 21124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:39.474968 21124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:39.481961 21124 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:34835
I20260811 14:58:39.481986 21243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:34835 every 8 connection(s)
I20260811 14:58:39.482897 21124 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:39.484350 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 21124
I20260811 14:58:39.484473 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:39.484766 12165 external_mini_cluster.cc:1428] Setting key 563a4b1a7416813478b26016ce211cf6
I20260811 14:58:39.486344 21244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:39.491848 21244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2: Bootstrap starting.
I20260811 14:58:39.494091 21248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.486194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.11.225.126:34835)
0811 14:58:39.486852 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.486867 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.486902 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:58:39.487570 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.487584 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.487974 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.488360 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:39.488773 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.489778 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.490706 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.491203 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.491376 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.492332 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:39.492337 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:39.492349 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:39.492727 (+ 378us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:39.492786 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:39.492806 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:39.492884 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:39.493098 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 14:58:39.493393 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":138,"threads_started":1}
I20260811 14:58:39.494297 21244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:39.495019 21244 log.cc:824] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:39.496763 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:58:39.497083 21244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2: No bootstrap required, opened a new log
I20260811 14:58:39.500526 21244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } }
I20260811 14:58:39.500741 21244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:39.500775 21244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1511a75afc5341278f196d832c3d26c2, State: Initialized, Role: FOLLOWER
I20260811 14:58:39.501125 21244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } }
I20260811 14:58:39.501281 21244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:39.501334 21244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:39.501406 21244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:39.502211 21244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } }
I20260811 14:58:39.502542 21244 leader_election.cc:302] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1511a75afc5341278f196d832c3d26c2; no voters:
I20260811 14:58:39.502825 21244 leader_election.cc:288] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:39.502923 21250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:39.503191 21250 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [term 1 LEADER]: Becoming Leader. State: Replica: 1511a75afc5341278f196d832c3d26c2, State: Running, Role: LEADER
I20260811 14:58:39.503490 21250 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } }
I20260811 14:58:39.504004 21244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:39.505098 21252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1511a75afc5341278f196d832c3d26c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } } }
I20260811 14:58:39.505267 21252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.505602 21254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1511a75afc5341278f196d832c3d26c2. Latest consensus state: current_term: 1 leader_uuid: "1511a75afc5341278f196d832c3d26c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1511a75afc5341278f196d832c3d26c2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 34835 } } }
I20260811 14:58:39.505694 21268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:39.505707 21254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.508400 21268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:39.514040 21268 catalog_manager.cc:1347] Generated new cluster ID: 6d19cd2579bd44688827cdd6109e2a13
I20260811 14:58:39.514106 21268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:39.534462 21268 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:39.535425 21268 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:39.539324 21268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1511a75afc5341278f196d832c3d26c2: Generated new TSK 0
I20260811 14:58:39.540149 21268 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 14:58:39.574184 21295 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 14:58:39.574294 21295 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 14:58:39.574972 21248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.558759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.11.225.126:34835)
0811 14:58:39.558899 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.558904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.559084 (+ 180us) server_negotiation.cc:407] Connection header received
0811 14:58:39.559249 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.559252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.559328 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.559449 (+ 121us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:58:39.559656 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.560454 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.561328 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.561691 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.561794 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.562081 (+ 287us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:58:39.574566 (+ 12485us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34951/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 14:58:39.574830 (+ 264us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55452: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34951/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 14:58:39.575054 21248 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55452: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34951/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 14:58:39.575054 21294 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:39.558631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:34835 (local address 127.0.0.1:55452)
0811 14:58:39.558969 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:39.558981 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:39.559112 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:39.559453 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:39.559455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:39.559461 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:58:39.559557 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.559561 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.560564 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.560567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.561187 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.561194 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.561802 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.561805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.561879 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.561904 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:58:39.574745 (+ 12841us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34951/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 14:58:39.574878 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.225.126:34835: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34951/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":113,"threads_started":1}
I20260811 14:58:39.575816 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 21124
2026-08-11T14:58:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (326 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 14:58:39.621934 12165 mini_oidc.cc:152] Starting JWKS server
I20260811 14:58:39.622809 12165 webserver.cc:460] Webserver started at https://127.0.0.1:44041/ using document root <none> and password file <none>
I20260811 14:58:39.622946 12165 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 14:58:39.623230 12165 webserver.cc:460] Webserver started at http://127.0.0.1:43483/ using document root <none> and password file <none>
2026-08-11T14:58:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:39Z Disabled control of system clock
I20260811 14:58:39.635733 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33139
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:34461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33139
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44041/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 14:58:39.750360 21306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:39.750625 21306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:39.750667 21306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:39.754572 21306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:39.754621 21306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:39.754637 21306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:39.754655 21306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:39.754669 21306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:58:39.754685 21306 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:58:39.754698 21306 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44041/jwks.json
I20260811 14:58:39.759294 21306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33139
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44041/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:39.760257 21306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:39.761626 21306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:39.770031 21324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:39.770057 21320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:39.770072 21322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:39.770308 21306 server_base.cc:1034] running on GCE node
I20260811 14:58:39.771035 21306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:39.772137 21306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:39.773276 21306 hybrid_clock.cc:648] HybridClock initialized: now 1786460319773247 us; error 46 us; skew 500 ppm
I20260811 14:58:39.775098 21306 webserver.cc:460] Webserver started at http://127.11.225.126:44763/ using document root <none> and password file <none>
I20260811 14:58:39.775693 21306 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:39.775782 21306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:39.776017 21306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:39.778172 21306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "1d25d5f3633340aea85596243b49a9cc"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "622de7de1ad12a95a51db753ec1aadc8"
server_key_iv: "20694814ced4a064cf5917bc47da2a4f"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.778754 21306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "1d25d5f3633340aea85596243b49a9cc"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "622de7de1ad12a95a51db753ec1aadc8"
server_key_iv: "20694814ced4a064cf5917bc47da2a4f"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.782480 21306 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 14:58:39.784986 21334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:39.786340 21306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:39.786484 21306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "1d25d5f3633340aea85596243b49a9cc"
format_stamp: "Formatted at 2026-08-11 14:58:39 on dist-test-slave-8hhm"
server_key: "622de7de1ad12a95a51db753ec1aadc8"
server_key_iv: "20694814ced4a064cf5917bc47da2a4f"
server_key_version: "encryptionkey@0"
I20260811 14:58:39.786602 21306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:39.817245 21306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:39.818032 21306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:39.818259 21306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:39.825874 21306 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:33139
I20260811 14:58:39.825891 21430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:33139 every 8 connection(s)
I20260811 14:58:39.826870 21306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:39.830159 21432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:39.833019 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 21306
I20260811 14:58:39.833149 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:39.833510 12165 external_mini_cluster.cc:1428] Setting key 4807cdf430fb00bf8f379d79c63087e2
I20260811 14:58:39.836547 21432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc: Bootstrap starting.
I20260811 14:58:39.838948 21432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:39.839687 21432 log.cc:824] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:39.841964 21432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc: No bootstrap required, opened a new log
I20260811 14:58:39.843199 21437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.835018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.11.225.126:33139)
0811 14:58:39.835695 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.835710 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.835746 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:39.836370 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.836395 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.836883 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.837260 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:39.837719 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.838723 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.839674 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.840311 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.840483 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.841384 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:39.841389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:39.841402 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:39.841807 (+ 405us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:39.841861 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:39.841881 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:39.841958 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:39.842186 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 14:58:39.842472 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":122,"threads_started":1}
I20260811 14:58:39.845645 21432 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } }
I20260811 14:58:39.845906 21432 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:39.845937 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:58:39.845981 21432 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d25d5f3633340aea85596243b49a9cc, State: Initialized, Role: FOLLOWER
I20260811 14:58:39.846405 21432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } }
I20260811 14:58:39.846547 21432 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:39.846614 21432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:39.846727 21432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:39.847756 21432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } }
I20260811 14:58:39.848044 21432 leader_election.cc:302] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d25d5f3633340aea85596243b49a9cc; no voters:
I20260811 14:58:39.848281 21432 leader_election.cc:288] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:39.848388 21439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:39.848623 21439 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [term 1 LEADER]: Becoming Leader. State: Replica: 1d25d5f3633340aea85596243b49a9cc, State: Running, Role: LEADER
I20260811 14:58:39.848949 21439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } }
I20260811 14:58:39.849581 21432 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:39.850654 21444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d25d5f3633340aea85596243b49a9cc. Latest consensus state: current_term: 1 leader_uuid: "1d25d5f3633340aea85596243b49a9cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } } }
I20260811 14:58:39.850800 21444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.851132 21442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d25d5f3633340aea85596243b49a9cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d25d5f3633340aea85596243b49a9cc" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33139 } } }
I20260811 14:58:39.851214 21455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:39.851236 21442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:39.854423 21455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:39.860008 21455 catalog_manager.cc:1347] Generated new cluster ID: 58363d8b95344c4bb1ae36109b2e2a38
I20260811 14:58:39.860095 21455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:39.884333 21455 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:39.885365 21455 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:39.889670 21455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d25d5f3633340aea85596243b49a9cc: Generated new TSK 0
I20260811 14:58:39.890431 21455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:58:39.913686 21437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:39.908668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.11.225.126:33139)
0811 14:58:39.908827 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:39.908832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:39.909069 (+ 237us) server_negotiation.cc:407] Connection header received
0811 14:58:39.909277 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:39.909280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:39.909329 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:39.909459 (+ 130us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:58:39.909719 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.910278 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.911466 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.911677 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.911763 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.912077 (+ 314us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:58:39.913300 (+ 1223us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 14:58:39.913545 (+ 245us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48908: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 14:58:39.913774 21473 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:39.908613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33139 (local address 127.0.0.1:48908)
0811 14:58:39.908976 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:39.908991 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:39.909110 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:39.909452 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:39.909455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:39.909463 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:58:39.909612 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.909618 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.910380 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.910384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.911357 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:39.911367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:39.911801 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:39.911805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:39.911895 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:39.911923 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:58:39.913456 (+ 1533us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 14:58:39.913592 (+ 136us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.225.126:33139: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":160,"threads_started":1}
W20260811 14:58:39.913766 21437 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48908: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260811 14:58:39.914265 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 21306
E20260811 14:58:39.931420 21474 webserver.cc:533] Webserver: sslize failed:
E20260811 14:58:39.931495 21474 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T14:58:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (341 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T14:58:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:39Z Disabled control of system clock
I20260811 14:58:39.973104 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:44007
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:44007
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/testchainca.cert with env {}
W20260811 14:58:40.086807 21484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:40.087069 21484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:40.087109 21484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:40.091037 21484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:40.091094 21484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:40.091110 21484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:40.091125 21484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:40.091171 21484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 14:58:40.091187 21484 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 14:58:40.091200 21484 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 14:58:40.096454 21484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:44007
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:44007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:40.097507 21484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:40.098465 21484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:40.106855 21491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:40.107017 21495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:40.106871 21490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:40.107079 21484 server_base.cc:1034] running on GCE node
I20260811 14:58:40.107733 21484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:40.108845 21484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:40.110023 21484 hybrid_clock.cc:648] HybridClock initialized: now 1786460320109990 us; error 44 us; skew 500 ppm
I20260811 14:58:40.111933 21484 webserver.cc:460] Webserver started at http://127.11.225.126:33607/ using document root <none> and password file <none>
I20260811 14:58:40.112468 21484 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:40.112525 21484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:40.112689 21484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:40.114749 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed"
format_stamp: "Formatted at 2026-08-11 14:58:40 on dist-test-slave-8hhm"
server_key: "6fca837fc8ead774ba842ce6dc1c012a"
server_key_iv: "336f11886bee3b97a9b13004f3bc28eb"
server_key_version: "encryptionkey@0"
I20260811 14:58:40.115269 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed"
format_stamp: "Formatted at 2026-08-11 14:58:40 on dist-test-slave-8hhm"
server_key: "6fca837fc8ead774ba842ce6dc1c012a"
server_key_iv: "336f11886bee3b97a9b13004f3bc28eb"
server_key_version: "encryptionkey@0"
I20260811 14:58:40.118876 21484 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 14:58:40.121173 21514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:40.122503 21484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:40.122614 21484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed"
format_stamp: "Formatted at 2026-08-11 14:58:40 on dist-test-slave-8hhm"
server_key: "6fca837fc8ead774ba842ce6dc1c012a"
server_key_iv: "336f11886bee3b97a9b13004f3bc28eb"
server_key_version: "encryptionkey@0"
I20260811 14:58:40.122702 21484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:40.148398 21484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:40.149138 21484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:40.149355 21484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:40.156848 21484 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:44007
I20260811 14:58:40.156869 21608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:44007 every 8 connection(s)
I20260811 14:58:40.157892 21484 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:40.158931 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 21484
I20260811 14:58:40.159062 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:40.159348 12165 external_mini_cluster.cc:1428] Setting key 45e0a955e2c0fd5e90ae06ccf6362b00
I20260811 14:58:40.161316 21610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:40.166978 21610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed: Bootstrap starting.
I20260811 14:58:40.168869 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:40.160848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.11.225.126:44007)
0811 14:58:40.161581 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:40.161598 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:40.161637 (+ 39us) server_negotiation.cc:407] Connection header received
0811 14:58:40.162352 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:40.162370 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:40.162847 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:40.163182 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:40.163683 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.164659 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.165651 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.166132 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.166313 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:40.167190 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:40.167195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:40.167207 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:58:40.167599 (+ 392us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:40.167654 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:58:40.167675 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:40.167786 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:40.167918 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 14:58:40.168171 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":127,"threads_started":1}
I20260811 14:58:40.169379 21610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:40.170235 21610 log.cc:824] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:40.171716 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 14:58:40.172345 21610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed: No bootstrap required, opened a new log
I20260811 14:58:40.175879 21610 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } }
I20260811 14:58:40.176120 21610 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:40.176198 21610 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd8bcde9e2b4e94ae9b3a6901eee5ed, State: Initialized, Role: FOLLOWER
I20260811 14:58:40.176620 21610 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } }
I20260811 14:58:40.176766 21610 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:40.176847 21610 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:40.176963 21610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:40.177910 21610 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } }
I20260811 14:58:40.178260 21610 leader_election.cc:302] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdd8bcde9e2b4e94ae9b3a6901eee5ed; no voters:
I20260811 14:58:40.178563 21610 leader_election.cc:288] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:40.178680 21621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:40.178915 21621 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [term 1 LEADER]: Becoming Leader. State: Replica: fdd8bcde9e2b4e94ae9b3a6901eee5ed, State: Running, Role: LEADER
I20260811 14:58:40.179239 21621 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } }
I20260811 14:58:40.179787 21610 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:40.180902 21625 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdd8bcde9e2b4e94ae9b3a6901eee5ed. Latest consensus state: current_term: 1 leader_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } } }
I20260811 14:58:40.181077 21625 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:40.181366 21626 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdd8bcde9e2b4e94ae9b3a6901eee5ed" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 44007 } } }
I20260811 14:58:40.181516 21626 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:40.182268 21638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:40.185297 21638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:40.190779 21638 catalog_manager.cc:1347] Generated new cluster ID: b7a5e4c11d9d49cc92461a15c564b928
I20260811 14:58:40.190850 21638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:40.198285 21638 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:40.199391 21638 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:40.220427 21638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdd8bcde9e2b4e94ae9b3a6901eee5ed: Generated new TSK 0
I20260811 14:58:40.221341 21638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:58:40.721609 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:40.231653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.11.225.126:44007)
0811 14:58:40.231785 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:40.231791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:40.231969 (+ 178us) server_negotiation.cc:407] Connection header received
0811 14:58:40.232194 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:40.232196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:40.232243 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:40.232351 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0811 14:58:40.232604 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.233128 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.234062 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.234269 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.234373 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:40.234703 (+ 330us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 14:58:40.721024 (+486321us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 14:58:40.721427 (+ 403us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46162: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 14:58:40.721738 21619 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46162: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 14:58:40.721801 21659 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:40.231570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:44007 (local address 127.0.0.1:46162)
0811 14:58:40.231883 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:40.231895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:40.232021 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:40.232362 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:40.232365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:40.232373 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 14:58:40.232497 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:40.232502 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.233267 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.233270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:40.233919 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:40.233928 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:40.234397 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:40.234401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:40.234493 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:40.234514 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 14:58:40.721322 (+486808us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 14:58:40.721554 (+ 232us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.225.126:44007: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":124,"threads_started":1}
I20260811 14:58:40.722736 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 21484
2026-08-11T14:58:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (792 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (130 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (153 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:41 dist-test-slave-8hhm krb5kdc[21675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:41 dist-test-slave-8hhm krb5kdc[21675](info): set up 2 sockets
Aug 11 14:58:41 dist-test-slave-8hhm krb5kdc[21675](info): commencing operation
krb5kdc: starting...
W20260811 14:58:42.310017 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:42 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:42.435798 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:42.552525 21703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:42.552778 21703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:42.552821 21703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:42.556768 21703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:42.556833 21703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:42.556856 21703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:42.556876 21703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:42.556895 21703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:42.562140 21703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:42.563125 21703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:42.564079 21703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:42.572732 21708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:42.572762 21712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:42.572732 21709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:42.573035 21703 server_base.cc:1034] running on GCE node
I20260811 14:58:42.573771 21703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:42.574873 21703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:42.576109 21703 hybrid_clock.cc:648] HybridClock initialized: now 1786460322576074 us; error 47 us; skew 500 ppm
Aug 11 14:58:42 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460322, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:42.582674 21703 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:42.583633 21703 webserver.cc:460] Webserver started at http://127.11.225.126:33731/ using document root <none> and password file <none>
I20260811 14:58:42.584206 21703 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:42.584301 21703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:42.584551 21703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:42.586778 21703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "e364b4fbe3ad416e9421511fb0a66149"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "46002c633d437689d2d1ecc90d5836ac"
server_key_iv: "5b9115cf8974a938d19c820d38292664"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.587380 21703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "e364b4fbe3ad416e9421511fb0a66149"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "46002c633d437689d2d1ecc90d5836ac"
server_key_iv: "5b9115cf8974a938d19c820d38292664"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.591332 21703 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:42.593922 21724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:42.595306 21703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:42.595461 21703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "e364b4fbe3ad416e9421511fb0a66149"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "46002c633d437689d2d1ecc90d5836ac"
server_key_iv: "5b9115cf8974a938d19c820d38292664"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.595588 21703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:42.613521 21703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:42.616307 21703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:42.616499 21703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:42.623888 21703 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45931
I20260811 14:58:42.623914 21816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45931 every 8 connection(s)
I20260811 14:58:42.624835 21703 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:42.627560 21817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:42.632730 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 21703
I20260811 14:58:42.632834 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:42.633247 12165 external_mini_cluster.cc:1428] Setting key 6c2a064917695ca3f8fbc6e327721c86
I20260811 14:58:42.634282 21817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149: Bootstrap starting.
I20260811 14:58:42.636552 21817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:42.637367 21817 log.cc:824] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:42.639225 21817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149: No bootstrap required, opened a new log
Aug 11 14:58:42 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:42.643038 21817 raft_consensus.cc:348] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 14:58:42.643272 21817 raft_consensus.cc:374] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:42.643345 21817 raft_consensus.cc:729] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e364b4fbe3ad416e9421511fb0a66149, State: Initialized, Role: FOLLOWER
I20260811 14:58:42.643791 21817 consensus_queue.cc:260] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 14:58:42.643937 21817 raft_consensus.cc:388] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:42.644016 21817 raft_consensus.cc:482] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:42.644137 21817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:42.644989 21817 raft_consensus.cc:504] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 14:58:42.645407 21817 leader_election.cc:302] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e364b4fbe3ad416e9421511fb0a66149; no voters:
I20260811 14:58:42.645701 21817 leader_election.cc:288] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:42.645808 21822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:42.646878 21817 sys_catalog.cc:564] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:42.648468 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:42.634798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.11.225.126:45931)
0811 14:58:42.635226 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:42.635246 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:42.635486 (+ 240us) server_negotiation.cc:407] Connection header received
0811 14:58:42.636223 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:42.636239 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:42.636570 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:42.636927 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:42.637810 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.638782 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.639758 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.640230 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.640396 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:42.643170 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:42.643175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:42.643188 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:42.643214 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:42.644979 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:42.645495 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:42.645500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:42.645506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:42.645646 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:42.646042 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:42.646048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:42.646049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:42.646507 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:42.646869 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:42.647081 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 14:58:42.647387 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":147,"threads_started":1}
I20260811 14:58:42.646063 21822 raft_consensus.cc:686] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [term 1 LEADER]: Becoming Leader. State: Replica: e364b4fbe3ad416e9421511fb0a66149, State: Running, Role: LEADER
I20260811 14:58:42.649130 21822 consensus_queue.cc:237] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 14:58:42.650627 21828 sys_catalog.cc:455] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e364b4fbe3ad416e9421511fb0a66149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 14:58:42.650753 21828 sys_catalog.cc:458] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:42.651139 21857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:42.651770 21832 sys_catalog.cc:455] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e364b4fbe3ad416e9421511fb0a66149. Latest consensus state: current_term: 1 leader_uuid: "e364b4fbe3ad416e9421511fb0a66149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e364b4fbe3ad416e9421511fb0a66149" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 14:58:42.651868 21832 sys_catalog.cc:458] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:42.654114 21857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:42.659708 21857 catalog_manager.cc:1347] Generated new cluster ID: d26360df3ec042dda4b8258064797069
I20260811 14:58:42.659775 21857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:42.671487 21857 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:42.672384 21857 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:42.680465 21857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e364b4fbe3ad416e9421511fb0a66149: Generated new TSK 0
I20260811 14:58:42.681311 21857 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:42.718506 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:42.859833 21866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:42.860091 21866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:42.860132 21866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:42.864076 21866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:42.864127 21866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:42.864182 21866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:42.869223 21866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:42.870168 21866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:42.871122 21866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:42.881245 21876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:42.881246 21877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:42.881397 21879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:42.881791 21866 server_base.cc:1034] running on GCE node
I20260811 14:58:42.882225 21866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:42.883127 21866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:42.884301 21866 hybrid_clock.cc:648] HybridClock initialized: now 1786460322884271 us; error 50 us; skew 500 ppm
Aug 11 14:58:42 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460322, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:42.888266 21866 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:42.889093 21866 webserver.cc:460] Webserver started at http://127.11.225.65:43937/ using document root <none> and password file <none>
I20260811 14:58:42.889688 21866 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:42.889750 21866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:42.889917 21866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:42.891978 21866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "1fad6fe0de1e47e68753cdd712d23e14"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "0eab179c8a0782c79c5bcad812b957cb"
server_key_iv: "bd1d8dc8b58209717e4d8fd23d4b0a8c"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.892570 21866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "1fad6fe0de1e47e68753cdd712d23e14"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "0eab179c8a0782c79c5bcad812b957cb"
server_key_iv: "bd1d8dc8b58209717e4d8fd23d4b0a8c"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.896334 21866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 14:58:42.898782 21887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:42.899977 21866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:42.900086 21866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "1fad6fe0de1e47e68753cdd712d23e14"
format_stamp: "Formatted at 2026-08-11 14:58:42 on dist-test-slave-8hhm"
server_key: "0eab179c8a0782c79c5bcad812b957cb"
server_key_iv: "bd1d8dc8b58209717e4d8fd23d4b0a8c"
server_key_version: "encryptionkey@0"
I20260811 14:58:42.900164 21866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:42.919888 21866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:42.922667 21866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:42.922816 21866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:42.923326 21866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:42.924116 21866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:42.924163 21866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:42.924202 21866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:42.924224 21866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:42.933115 21866 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:32989
I20260811 14:58:42.933146 22086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:32989 every 8 connection(s)
I20260811 14:58:42.933991 21866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:42.935894 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 21866
I20260811 14:58:42.936020 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:42.936345 12165 external_mini_cluster.cc:1428] Setting key 24813db6a02da8edb671e0f238937de1
Aug 11 14:58:42 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460322, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:42.949054 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:42.935736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51277 (local address 127.11.225.126:45931)
0811 14:58:42.935867 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:42.935871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:42.937130 (+ 1259us) server_negotiation.cc:407] Connection header received
0811 14:58:42.938547 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:42.938551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:42.938605 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:42.938713 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:42.939949 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.940489 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.941885 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.942136 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.942245 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:42.945327 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:42.945330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:42.945333 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:42.945355 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:42.946835 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:42.947416 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:42.947420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:42.947424 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:42.947512 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:42.947883 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:42.947886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:42.947888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:42.948108 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:42.948230 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:42.948717 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 14:58:42.948861 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:58:42.949908 22092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:42.936166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.65:51277)
0811 14:58:42.936968 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:42.937021 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:42.938325 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:42.938890 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:42.938897 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:42.939237 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:42.939772 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:42.939795 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.940612 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.940617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:42.941762 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:42.941772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:42.942324 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:42.942330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:42.942581 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:42.943325 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:42.943355 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:42.945119 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:42.946958 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:42.946963 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:42.946978 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:42.947242 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:42.947620 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:42.947623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:42.947626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:42.947782 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:42.948230 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:42.948237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:42.948473 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 14:58:42.948657 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 14:58:42.949034 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":140,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 14:58:42.951129 22088 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 14:58:42.951443 22088 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:42.952052 22088 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 14:58:42.953716 21751 ts_manager.cc:194] Registered new tserver with Master: 1fad6fe0de1e47e68753cdd712d23e14 (127.11.225.65:32989)
I20260811 14:58:42.954789 21751 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:51277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:42.968454 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:43.079905 22096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:43.080186 22096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:43.080255 22096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:43.084187 22096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:43.084270 22096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:43.084357 22096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:43.089613 22096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:43.090687 22096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:43.091732 22096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:43.101485 22105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:43.101497 22112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:43.101507 22106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:43.101828 22096 server_base.cc:1034] running on GCE node
I20260811 14:58:43.102195 22096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:43.102876 22096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:43.104087 22096 hybrid_clock.cc:648] HybridClock initialized: now 1786460323104052 us; error 31 us; skew 500 ppm
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.107051 22096 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:43.107903 22096 webserver.cc:460] Webserver started at http://127.11.225.66:38519/ using document root <none> and password file <none>
I20260811 14:58:43.108436 22096 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:43.108505 22096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:43.108676 22096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:43.110795 22096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "2bbc889a1e03499db0134c9d85c6e015"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "02a68bc92ac65bdb576deea2205b490b"
server_key_iv: "4abccb0e768e4a6552f5b27c13b79fbf"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.111371 22096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "2bbc889a1e03499db0134c9d85c6e015"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "02a68bc92ac65bdb576deea2205b490b"
server_key_iv: "4abccb0e768e4a6552f5b27c13b79fbf"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.115373 22096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:43.117961 22121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.119310 22096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:43.119462 22096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "2bbc889a1e03499db0134c9d85c6e015"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "02a68bc92ac65bdb576deea2205b490b"
server_key_iv: "4abccb0e768e4a6552f5b27c13b79fbf"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.119585 22096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:43.146907 22096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:43.150728 22096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:43.150962 22096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:43.151583 22096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:43.152503 22096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:43.152559 22096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.152628 22096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:43.152664 22096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.161382 22096 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:36613
I20260811 14:58:43.161437 22311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:36613 every 8 connection(s)
I20260811 14:58:43.162334 22096 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:43.165253 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 22096
I20260811 14:58:43.165355 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:43.165663 12165 external_mini_cluster.cc:1428] Setting key 288ca1e300ec71f17d47c4880a716321
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:43.177963 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.164188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:58023 (local address 127.11.225.126:45931)
0811 14:58:43.164327 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.164330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.165279 (+ 949us) server_negotiation.cc:407] Connection header received
0811 14:58:43.166936 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.166939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.166993 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.167075 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.168267 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.169102 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.170942 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.171176 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.171280 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.174175 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:43.174178 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:43.174181 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:43.174206 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:43.175752 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.176290 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.176293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.176294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.176373 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.176734 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.176737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.176739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.176924 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:43.177068 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:43.177646 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 14:58:43.177781 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:58:43.178869 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.164608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.66:58023)
0811 14:58:43.165115 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:43.165159 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:43.166673 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:43.167270 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:43.167277 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:43.167633 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:43.168116 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:43.168130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.169291 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.169297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:43.170792 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:43.170806 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.171359 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.171363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:43.171559 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.172214 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:43.172231 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:43.173993 (+ 1762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:43.175881 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:43.175887 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:43.175902 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:43.176175 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:43.176476 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:43.176480 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:43.176481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:43.176631 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:43.177031 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:43.177038 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:43.177376 (+ 338us) client_negotiation.cc:769] Sending connection context
0811 14:58:43.177585 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 14:58:43.177919 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:43.180225 22312 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 14:58:43.180483 22312 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:43.181123 22312 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 14:58:43.182412 21751 ts_manager.cc:194] Registered new tserver with Master: 2bbc889a1e03499db0134c9d85c6e015 (127.11.225.66:36613)
I20260811 14:58:43.183002 21751 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:58023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:43.196373 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:43.315166 22319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:43.315466 22319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:43.315548 22319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:43.321228 22319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:43.321317 22319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:43.321403 22319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:43.326941 22319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:43.328063 22319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:43.329113 22319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:43.339071 22328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:43.339078 22332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:43.339087 22327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:43.339357 22319 server_base.cc:1034] running on GCE node
I20260811 14:58:43.339751 22319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:43.340428 22319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:43.341609 22319 hybrid_clock.cc:648] HybridClock initialized: now 1786460323341590 us; error 28 us; skew 500 ppm
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.344503 22319 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:43.345504 22319 webserver.cc:460] Webserver started at http://127.11.225.67:34283/ using document root <none> and password file <none>
I20260811 14:58:43.346076 22319 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:43.346168 22319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:43.346416 22319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:43.348563 22319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "9a804fae640f4734bf42ca02904be629"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "232606b5b6bebd6ccc418eb8df86c9c8"
server_key_iv: "c7c1b405b171d8820f520deb64d5176a"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.349164 22319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "9a804fae640f4734bf42ca02904be629"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "232606b5b6bebd6ccc418eb8df86c9c8"
server_key_iv: "c7c1b405b171d8820f520deb64d5176a"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.352896 22319 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:43.355376 22345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.356585 22319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:43.356719 22319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "9a804fae640f4734bf42ca02904be629"
format_stamp: "Formatted at 2026-08-11 14:58:43 on dist-test-slave-8hhm"
server_key: "232606b5b6bebd6ccc418eb8df86c9c8"
server_key_iv: "c7c1b405b171d8820f520deb64d5176a"
server_key_version: "encryptionkey@0"
I20260811 14:58:43.356829 22319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:43.372591 22319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:43.375586 22319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:43.375785 22319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:43.376392 22319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:43.377292 22319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:43.377357 22319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.377424 22319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:43.377470 22319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:43.386744 22319 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:39123
I20260811 14:58:43.386773 22534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:39123 every 8 connection(s)
I20260811 14:58:43.387632 22319 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:43.393509 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 22319
I20260811 14:58:43.393646 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:43.393946 12165 external_mini_cluster.cc:1428] Setting key 090c2c9f9c949746e66ba492f5ace3e2
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:43.401628 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.389529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:39929 (local address 127.11.225.126:45931)
0811 14:58:43.389692 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.389697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.390567 (+ 870us) server_negotiation.cc:407] Connection header received
0811 14:58:43.391897 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.391900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.391949 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.392058 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.393275 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.393886 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.395328 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.395561 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.395668 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.398153 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:43.398157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:43.398160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:43.398209 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:43.399559 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.400079 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.400083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.400085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.400180 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.400531 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.400535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.400537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.400721 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:43.400829 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:43.401344 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 14:58:43.401463 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:58:43.402485 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.389945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.67:39929)
0811 14:58:43.390398 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:43.390442 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:43.391684 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:43.392206 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:43.392212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:43.392602 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:43.393105 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:43.393119 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.394016 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.394021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:43.395200 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:43.395209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.395710 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.395714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:43.395896 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.396455 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:43.396486 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:43.397993 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:43.399680 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:43.399686 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:43.399701 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:43.399977 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:43.400278 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:43.400281 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:43.400283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:43.400427 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:43.400828 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:43.400837 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:43.401076 (+ 239us) client_negotiation.cc:769] Sending connection context
0811 14:58:43.401303 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 14:58:43.401641 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260811 14:58:43.403724 22536 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 14:58:43.403947 22536 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:43.404429 22536 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 14:58:43.405561 21751 ts_manager.cc:194] Registered new tserver with Master: 9a804fae640f4734bf42ca02904be629 (127.11.225.67:39123)
I20260811 14:58:43.406147 21751 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:39929
I20260811 14:58:43.408056 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/test-admin.keytab.
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.425063 12165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 14:58:43.427976 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:43.426439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35134 (local address 127.11.225.65:32989)
0811 14:58:43.426731 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.426746 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.426770 (+ 24us) server_negotiation.cc:407] Connection header received
0811 14:58:43.426820 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.426826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.426999 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.427226 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.427784 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35134: BlockingRecv error: recv got EOF from 127.0.0.1:35134 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
W20260811 14:58:43.428242 12165 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc' of type FILE
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.429277 12165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.430200 12165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:43.439687 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.431104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.11.225.65:32989)
0811 14:58:43.431215 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.431218 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.431313 (+ 95us) server_negotiation.cc:407] Connection header received
0811 14:58:43.431393 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.431395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.431437 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.431516 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.432041 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.432804 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.433747 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.434109 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.434195 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.436417 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:43.436427 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:43.436440 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:43.436463 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:43.438028 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.438429 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.438434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.438435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.438513 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.438746 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.438748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.438749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.438974 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:43.439152 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:43.439439 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 14:58:43.439562 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 14:58:43.443660 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:43.442552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.11.225.65:32989)
0811 14:58:43.442730 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.442734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.442872 (+ 138us) server_negotiation.cc:407] Connection header received
0811 14:58:43.443013 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.443016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.443079 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.443162 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.443543 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35148: BlockingRecv error: recv got EOF from 127.0.0.1:35148 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260811 14:58:43.443964 12165 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc)
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.444988 12165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.445915 12165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:43.454447 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.446728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35150 (local address 127.11.225.65:32989)
0811 14:58:43.446869 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.446873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.446994 (+ 121us) server_negotiation.cc:407] Connection header received
0811 14:58:43.447155 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.447158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.447200 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.447281 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.447896 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.448409 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.449258 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.449489 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.449600 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.451659 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:43.451663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:43.451665 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:43.451686 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:43.452849 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.453315 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.453319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.453321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.453399 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.453670 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.453674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.453676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.453833 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:43.453964 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:43.454201 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 14:58:43.454315 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 14:58:43.456758 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:43.455921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.11.225.65:32989)
0811 14:58:43.456056 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.456059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.456149 (+ 90us) server_negotiation.cc:407] Connection header received
0811 14:58:43.456230 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.456232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.456264 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.456327 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.456646 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35160: BlockingRecv error: recv got EOF from 127.0.0.1:35160 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 14:58:43.456897 12165 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460289406450-12165-0/krb5kdc/krb5cc)
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.457875 12165 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:43.458737 12165 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[21675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 14:58:43.467213 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:43.459497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35168 (local address 127.11.225.65:32989)
0811 14:58:43.459615 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:43.459619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:43.459724 (+ 105us) server_negotiation.cc:407] Connection header received
0811 14:58:43.459858 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:43.459860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:43.459902 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:43.459975 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:43.460505 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.460977 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.461843 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:43.462069 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:43.462171 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:43.464148 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:43.464151 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:43.464154 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:43.464181 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:43.465409 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.465933 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.465939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.465941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.466044 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:43.466357 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:43.466361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:43.466363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:43.466547 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:43.466688 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:43.466946 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 14:58:43.467059 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:43.468209 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 21866
I20260811 14:58:43.480384 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 22096
I20260811 14:58:43.505340 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 22319
I20260811 14:58:43.519783 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 21703
2026-08-11T14:58:43Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2507 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[22570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[22570](info): set up 2 sockets
Aug 11 14:58:43 dist-test-slave-8hhm krb5kdc[22570](info): commencing operation
krb5kdc: starting...
W20260811 14:58:44.799345 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:44 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab.
Entry for principal oryx/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab.
I20260811 14:58:44.936291 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46185
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab
--principal=oryx/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:46185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:45.055166 22591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:45.055608 22591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:45.055696 22591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:45.061899 22591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:45.061975 22591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:45.061995 22591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:45.062019 22591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:45.062036 22591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:45.067706 22591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:46185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab
--principal=oryx/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:45.068863 22591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:45.070035 22591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:45.079054 22602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.079053 22597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.079049 22599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:45.079344 22591 server_base.cc:1034] running on GCE node
I20260811 14:58:45.080159 22591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:45.081385 22591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:45.082561 22591 hybrid_clock.cc:648] HybridClock initialized: now 1786460325082527 us; error 50 us; skew 500 ppm
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:45.085512 22591 init.cc:377] Logged in from keytab as oryx/127.11.225.126@KRBTEST.COM (short username oryx)
I20260811 14:58:45.086402 22591 webserver.cc:460] Webserver started at http://127.11.225.126:32909/ using document root <none> and password file <none>
I20260811 14:58:45.086943 22591 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:45.087002 22591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:45.087183 22591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:45.089304 22591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "26b69f7bdc9f466cb34829df09732245"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "d90fd0370a1796c787b1f04a0337e545"
server_key_iv: "760d5e8923ca9b6036a9d361702f7e6b"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.089864 22591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "26b69f7bdc9f466cb34829df09732245"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "d90fd0370a1796c787b1f04a0337e545"
server_key_iv: "760d5e8923ca9b6036a9d361702f7e6b"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.093772 22591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 14:58:45.096212 22612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.097592 22591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:45.097719 22591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "26b69f7bdc9f466cb34829df09732245"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "d90fd0370a1796c787b1f04a0337e545"
server_key_iv: "760d5e8923ca9b6036a9d361702f7e6b"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.097824 22591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:45.113523 22591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:45.116411 22591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:45.116626 22591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:45.124167 22591 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:46185
I20260811 14:58:45.124472 22711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:46185 every 8 connection(s)
I20260811 14:58:45.125169 22591 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:45.128155 22712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:45.133710 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 22591
I20260811 14:58:45.133821 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:45.134166 12165 external_mini_cluster.cc:1428] Setting key f325fa1d203dbcedad9bda60291dcf6f
I20260811 14:58:45.134131 22712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Bootstrap starting.
I20260811 14:58:45.136852 22712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:45.137672 22712 log.cc:824] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:45.139706 22712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: No bootstrap required, opened a new log
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:45.144140 22712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } }
I20260811 14:58:45.144454 22712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:45.144562 22712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b69f7bdc9f466cb34829df09732245, State: Initialized, Role: FOLLOWER
I20260811 14:58:45.145097 22712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } }
I20260811 14:58:45.145301 22712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:45.145398 22712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:45.145545 22712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:45.146808 22712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } }
I20260811 14:58:45.147192 22712 leader_election.cc:302] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26b69f7bdc9f466cb34829df09732245; no voters:
I20260811 14:58:45.147550 22712 leader_election.cc:288] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:45.147657 22722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:45.147837 22722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 LEADER]: Becoming Leader. State: Replica: 26b69f7bdc9f466cb34829df09732245, State: Running, Role: LEADER
I20260811 14:58:45.148182 22722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } }
I20260811 14:58:45.148942 22712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:45.149545 22726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26b69f7bdc9f466cb34829df09732245. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } }
I20260811 14:58:45.149680 22726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:45.149967 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.135495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60474 (local address 127.11.225.126:46185)
0811 14:58:45.135940 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:45.135955 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:45.135991 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:45.136634 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:45.136652 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:45.137026 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:45.137426 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:45.138256 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.139247 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.140164 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.140630 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.140812 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.143783 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:45.143789 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:45.143802 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:45.143830 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:45.145922 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.146445 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.146449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.146454 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.146570 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.146948 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.146953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.146955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.147460 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:45.147666 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:45.148237 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 14:58:45.148876 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":145,"threads_started":1}
I20260811 14:58:45.150435 22724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } }
I20260811 14:58:45.150534 22724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:45.150859 22733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:45.154306 22733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:45.160322 22733 catalog_manager.cc:1347] Generated new cluster ID: 1dd8a1add5484ec6b30062d5c21fba96
I20260811 14:58:45.160403 22733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:45.170787 22733 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:45.171734 22733 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:45.178242 22733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Generated new TSK 0
I20260811 14:58:45.178879 22733 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
I20260811 14:58:45.216481 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:45.333724 22756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:45.334025 22756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:45.334105 22756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:45.338083 22756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:45.338176 22756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:45.338267 22756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:45.344039 22756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:45.345626 22756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:45.346769 22756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:45.357082 22764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.357154 22768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.357082 22765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:45.357372 22756 server_base.cc:1034] running on GCE node
I20260811 14:58:45.357869 22756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:45.358572 22756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:45.359763 22756 hybrid_clock.cc:648] HybridClock initialized: now 1786460325359744 us; error 30 us; skew 500 ppm
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:45.362712 22756 init.cc:377] Logged in from keytab as oryx/127.11.225.65@KRBTEST.COM (short username oryx)
I20260811 14:58:45.363691 22756 webserver.cc:460] Webserver started at http://127.11.225.65:34771/ using document root <none> and password file <none>
I20260811 14:58:45.364295 22756 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:45.364388 22756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:45.364638 22756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:45.366896 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "096ccda90f7f4063b305639d18caf674"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "5dba33aea5c46d51fd3a43f714eecaac"
server_key_iv: "60662e0b350c9b5cf8e7a6995b34564f"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.367498 22756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "096ccda90f7f4063b305639d18caf674"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "5dba33aea5c46d51fd3a43f714eecaac"
server_key_iv: "60662e0b350c9b5cf8e7a6995b34564f"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.371541 22756 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 14:58:45.374253 22781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.375715 22756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:45.375856 22756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "096ccda90f7f4063b305639d18caf674"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "5dba33aea5c46d51fd3a43f714eecaac"
server_key_iv: "60662e0b350c9b5cf8e7a6995b34564f"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.375976 22756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:45.390386 22756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:45.393648 22756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:45.393857 22756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:45.394474 22756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:45.395349 22756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:45.395419 22756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.395491 22756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:45.395532 22756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.404851 22756 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:44005
I20260811 14:58:45.404915 22984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:44005 every 8 connection(s)
I20260811 14:58:45.405838 22756 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:45.414146 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 22756
I20260811 14:58:45.414283 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:45.414595 12165 external_mini_cluster.cc:1428] Setting key 779019848fee477bd71069dd3ec4e086
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:45.420042 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.407690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:56113 (local address 127.11.225.126:46185)
0811 14:58:45.407865 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:45.407871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:45.408755 (+ 884us) server_negotiation.cc:407] Connection header received
0811 14:58:45.410248 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:45.410251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:45.410302 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:45.410387 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:45.411602 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.412147 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.413283 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.413513 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.413601 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.416281 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:45.416284 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:45.416286 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:45.416309 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:45.417821 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.418441 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.418445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.418447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.418542 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.418886 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.418889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.418891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.419083 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:45.419192 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:45.419811 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 14:58:45.419918 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:45.421392 22988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.408089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:56113)
0811 14:58:45.408568 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:45.408623 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:45.410018 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:45.410561 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:45.410568 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:45.410935 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:45.411451 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.411465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.412258 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.412260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.413121 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.413130 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.413660 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.413663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.413808 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.414474 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:45.414491 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:45.416113 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:45.417936 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.417945 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.417963 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.418328 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.418637 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.418640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.418642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.418788 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.419201 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:45.419211 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:45.419533 (+ 322us) client_negotiation.cc:769] Sending connection context
0811 14:58:45.419758 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 14:58:45.420152 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":138,"threads_started":1}
I20260811 14:58:45.422703 22985 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:45.422992 22985 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:45.423641 22985 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:45.425274 22647 ts_manager.cc:194] Registered new tserver with Master: 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
WARNING: no policy specified for oryx/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:58:45.426463 22647 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:56113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
I20260811 14:58:45.444809 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:45.561424 22994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:45.561688 22994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:45.561730 22994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:45.565685 22994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:45.565734 22994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:45.565789 22994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:45.570896 22994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:45.571897 22994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:45.572871 22994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:45.583238 23004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.583254 23002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.583257 23001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:45.583526 22994 server_base.cc:1034] running on GCE node
I20260811 14:58:45.583952 22994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:45.584649 22994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:45.585834 22994 hybrid_clock.cc:648] HybridClock initialized: now 1786460325585811 us; error 36 us; skew 500 ppm
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:45.588734 22994 init.cc:377] Logged in from keytab as oryx/127.11.225.66@KRBTEST.COM (short username oryx)
I20260811 14:58:45.589741 22994 webserver.cc:460] Webserver started at http://127.11.225.66:37045/ using document root <none> and password file <none>
I20260811 14:58:45.590324 22994 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:45.590415 22994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:45.590646 22994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:45.592746 22994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "b31d880db8f346ddb6768cc16a9adf9c"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "3b94e5dd91fd855d157095420440d453"
server_key_iv: "f478ad060ce0f82263e6801aaf246d16"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.593391 22994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "b31d880db8f346ddb6768cc16a9adf9c"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "3b94e5dd91fd855d157095420440d453"
server_key_iv: "f478ad060ce0f82263e6801aaf246d16"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.597265 22994 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:58:45.599838 23016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.601385 22994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:45.601537 22994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "b31d880db8f346ddb6768cc16a9adf9c"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "3b94e5dd91fd855d157095420440d453"
server_key_iv: "f478ad060ce0f82263e6801aaf246d16"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.601696 22994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:45.628720 22994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:45.631983 22994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:45.632169 22994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:45.632762 22994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:45.633760 22994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:45.633814 22994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.633893 22994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:45.633939 22994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.643956 22994 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:43025
I20260811 14:58:45.643980 23231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:43025 every 8 connection(s)
I20260811 14:58:45.644938 22994 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:45.653276 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 22994
I20260811 14:58:45.653410 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:45.653702 12165 external_mini_cluster.cc:1428] Setting key 11becff7bbd7af773f5abf682e6afe79
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:45.659950 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.646875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52739 (local address 127.11.225.126:46185)
0811 14:58:45.647034 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:45.647038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:45.647901 (+ 863us) server_negotiation.cc:407] Connection header received
0811 14:58:45.649772 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:45.649776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:45.649843 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:45.649947 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:45.651415 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.652040 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.653346 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.653686 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.653805 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.656439 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:45.656442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:45.656444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:45.656468 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:45.657922 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.658435 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.658439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.658441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.658523 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.658864 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.658868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.658870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.659060 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:45.659166 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:45.659662 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 14:58:45.659787 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:45.660866 23236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.647260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:52739)
0811 14:58:45.647734 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:45.647780 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:45.649525 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:45.650181 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:45.650196 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:45.650600 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:45.651272 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.651288 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.652179 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.652182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.653146 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.653156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.653850 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.653854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.654036 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.654668 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:45.654684 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:45.656266 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:45.658043 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.658051 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.658065 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.658331 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.658623 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.658626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.658628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.658770 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.659165 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:45.659173 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:45.659419 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 14:58:45.659617 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 14:58:45.659947 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":112,"threads_started":1}
I20260811 14:58:45.662073 23234 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:45.662325 23234 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:45.662820 23234 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:45.663919 22647 ts_manager.cc:194] Registered new tserver with Master: b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025)
I20260811 14:58:45.664855 22647 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:52739
WARNING: no policy specified for oryx/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
I20260811 14:58:45.684262 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:45.802057 23239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:45.802292 23239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:45.802333 23239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:45.806427 23239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:45.806488 23239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:45.806542 23239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:45.811640 23239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:45.812619 23239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:45.813659 23239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:45.823594 23249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.823603 23253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:45.823614 23257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:45.823706 23239 server_base.cc:1034] running on GCE node
I20260811 14:58:45.824429 23239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:45.825037 23239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:45.826210 23239 hybrid_clock.cc:648] HybridClock initialized: now 1786460325826191 us; error 30 us; skew 500 ppm
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:45.829063 23239 init.cc:377] Logged in from keytab as oryx/127.11.225.67@KRBTEST.COM (short username oryx)
I20260811 14:58:45.830000 23239 webserver.cc:460] Webserver started at http://127.11.225.67:34523/ using document root <none> and password file <none>
I20260811 14:58:45.830610 23239 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:45.830694 23239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:45.830909 23239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:45.833070 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "7ea5cbdba68343e89c50485c174a3a88"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "927bc0577db7289a493346aff3e0904e"
server_key_iv: "d32115829a32672fed1928acfb0ecc78"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.833721 23239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "7ea5cbdba68343e89c50485c174a3a88"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "927bc0577db7289a493346aff3e0904e"
server_key_iv: "d32115829a32672fed1928acfb0ecc78"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.837682 23239 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 14:58:45.840231 23268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.841665 23239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:45.841814 23239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "7ea5cbdba68343e89c50485c174a3a88"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "927bc0577db7289a493346aff3e0904e"
server_key_iv: "d32115829a32672fed1928acfb0ecc78"
server_key_version: "encryptionkey@0"
I20260811 14:58:45.841936 23239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:45.861203 23239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:45.864248 23239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:45.864485 23239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:45.865103 23239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:45.866025 23239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:45.866093 23239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.866164 23239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:45.866210 23239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:45.875772 23239 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:38811
I20260811 14:58:45.875795 23474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:38811 every 8 connection(s)
I20260811 14:58:45.876698 23239 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:45.881798 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 23239
I20260811 14:58:45.881920 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:45.882272 12165 external_mini_cluster.cc:1428] Setting key b851ea7d579d02b063196c85d9caba64
Aug 11 14:58:45 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:45.891034 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.878637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:57083 (local address 127.11.225.126:46185)
0811 14:58:45.878806 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:45.878811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:45.879779 (+ 968us) server_negotiation.cc:407] Connection header received
0811 14:58:45.881342 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:45.881346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:45.881400 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:45.881488 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:45.882869 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.883562 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.884818 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.885068 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.885160 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.887663 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:45.887667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:45.887669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:45.887696 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:45.889046 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.889600 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.889603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.889604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.889693 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:45.890044 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:45.890046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:45.890048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:45.890229 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:45.890313 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:45.890777 (+ 464us) server_negotiation.cc:299] Negotiation successful
0811 14:58:45.890879 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 14:58:45.891855 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:45.879042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:57083)
0811 14:58:45.879633 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:45.879694 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:45.881103 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:45.881648 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:45.881655 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:45.882156 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:45.882693 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.882707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.883684 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.883688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.884713 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:45.884723 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:45.885204 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:45.885207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:45.885412 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:45.885974 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:45.885990 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:45.887508 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:45.889182 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.889187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.889198 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.889510 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.889777 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:45.889780 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:45.889781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:45.889910 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:45.890324 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:45.890329 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:45.890554 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 14:58:45.890705 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 14:58:45.890947 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":135,"threads_started":1}
I20260811 14:58:45.893083 23475 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:45.893374 23475 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:45.893880 23475 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:45.895084 22647 ts_manager.cc:194] Registered new tserver with Master: 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:45.895875 22647 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:57083
I20260811 14:58:45.896597 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.225.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.125.keytab.
Entry for principal oryx/127.11.225.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.125.keytab.
I20260811 14:58:45.926525 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:43253
--webserver_interface=127.11.225.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.125.keytab
--principal=oryx/127.11.225.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:46185,127.11.225.125:43253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:46.038468 23486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:46.038751 23486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:46.038821 23486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:46.042699 23486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:46.042783 23486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:46.042820 23486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:46.042873 23486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:46.042910 23486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:46.048167 23486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:46185,127.11.225.125:43253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.125.keytab
--principal=oryx/127.11.225.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:43253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.225.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
W20260811 14:58:46.048403 23486 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.225.126:46185,127.11.225.125:43253'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 14:58:46.049307 23486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:46.050487 23486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.059016 23504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.059072 23499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.059218 23486 server_base.cc:1034] running on GCE node
W20260811 14:58:46.059381 23508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.059967 23486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.061085 23486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.062229 23486 hybrid_clock.cc:648] HybridClock initialized: now 1786460326062212 us; error 27 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.065124 23486 init.cc:377] Logged in from keytab as oryx/127.11.225.125@KRBTEST.COM (short username oryx)
I20260811 14:58:46.066026 23486 webserver.cc:460] Webserver started at http://127.11.225.125:43135/ using document root <none> and password file <none>
I20260811 14:58:46.066573 23486 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.066635 23486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.066896 23486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:46.068940 23486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/instance:
uuid: "72808cdfce23462ebd93e82096b4e944"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "117a1ae798369c3f8ecded855934b156"
server_key_iv: "082dd372c33a64db64fab38fa2f07b4b"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.069555 23486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal/instance:
uuid: "72808cdfce23462ebd93e82096b4e944"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "117a1ae798369c3f8ecded855934b156"
server_key_iv: "082dd372c33a64db64fab38fa2f07b4b"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.073122 23486 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 14:58:46.075471 23522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.076664 23486 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:46.076802 23486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "72808cdfce23462ebd93e82096b4e944"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "117a1ae798369c3f8ecded855934b156"
server_key_iv: "082dd372c33a64db64fab38fa2f07b4b"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.076910 23486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.124073 23486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:46.127684 23486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:46.127936 23486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:46.135800 23486 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.125:43253
I20260811 14:58:46.136116 23606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.125:43253 every 8 connection(s)
I20260811 14:58:46.136931 23486 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
I20260811 14:58:46.139768 23607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:46.143407 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 23486
I20260811 14:58:46.143551 23607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.125@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
I20260811 14:58:46.156692 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.145523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.11.225.126:46185)
0811 14:58:46.145645 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.145650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.145947 (+ 297us) server_negotiation.cc:407] Connection header received
0811 14:58:46.146757 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.146761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.146818 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.146915 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.147808 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.148339 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.149467 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.149752 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.149848 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.152661 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.152664 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.152667 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.152692 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.154374 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.155120 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.155123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.155124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.155192 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.155583 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.155587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.155589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.155804 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.155957 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.156402 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.156519 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:58:46.157593 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.145459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60482)
0811 14:58:46.145823 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.145862 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.146551 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.146973 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.146978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.147359 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.147670 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.147684 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.148479 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.148481 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.149347 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.149358 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.149906 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.149929 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.150157 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.150816 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.150832 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.152473 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.154480 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.154488 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.154498 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.154886 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.155295 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.155303 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.155305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.155471 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.155939 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.155946 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.156183 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.156357 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.156667 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":23,"spinlock_wait_cycles":4352,"thread_start_us":129,"threads_started":1}
I20260811 14:58:46.157598 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.145062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.11.225.125:43253)
0811 14:58:46.145617 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.145637 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.145675 (+ 38us) server_negotiation.cc:407] Connection header received
0811 14:58:46.146549 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.146568 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.146799 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.146986 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.147816 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.148656 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.149557 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.150199 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.150316 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.153081 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.153087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.153100 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.153126 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.154996 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.155430 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.155435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.155437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.155536 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.155810 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.155814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.155816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.156170 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.156396 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.156576 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.156721 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":383,"spinlock_wait_cycles":2816,"thread_start_us":206,"threads_started":1}
I20260811 14:58:46.159049 23607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.125@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
I20260811 14:58:46.166859 23612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.159496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40144)
0811 14:58:46.159634 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.159650 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.159717 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.159959 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.159961 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.160086 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.160174 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.160178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.160833 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.160835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.161392 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.161400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.162383 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.162386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.162458 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.162831 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.162841 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.163980 (+ 1139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.165688 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.165690 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.165692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.165868 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.166118 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.166120 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.166121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.166194 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.166490 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.166492 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.166565 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.166643 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.166732 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 14:58:46.166889 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.159576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40144 (local address 127.11.225.125:43253)
0811 14:58:46.159687 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.159691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.159704 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:46.159804 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.159807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.159856 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.159919 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.160266 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.160746 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.161493 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.162279 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.162366 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.164132 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.164135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.164136 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.164157 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.165602 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.165948 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.165950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.165952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.166020 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.166268 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.166270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.166271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.166416 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.166487 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.166694 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.166780 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 14:58:46.169629 23607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Bootstrap starting.
I20260811 14:58:46.171921 23607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:46.172653 23607 log.cc:824] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:46.174546 23607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: No bootstrap required, opened a new log
I20260811 14:58:46.177491 23607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } }
I20260811 14:58:46.177707 23607 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:46.177780 23607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72808cdfce23462ebd93e82096b4e944, State: Initialized, Role: FOLLOWER
I20260811 14:58:46.178203 23607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } }
I20260811 14:58:46.178656 23614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } } }
I20260811 14:58:46.178781 23614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:46.179409 23607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 14:58:46.184099 23633 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:58:46.184182 23633 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:58:46.186576 23486 master_runner.cc:428] Detected that this master 72808cdfce23462ebd93e82096b4e944 is joining an existing cluster
I20260811 14:58:46.186636 23486 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.225.125:43253
I20260811 14:58:46.197304 23643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.188632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60484)
0811 14:58:46.189183 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.189199 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.189336 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.189702 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.189705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.189925 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.190091 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.190100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.191152 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.191155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.191793 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.191801 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.192264 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.192268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.192404 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.192890 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.192908 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.193361 (+ 453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.195463 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.195466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.195468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.195798 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.196132 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.196134 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.196137 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.196226 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.196724 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.196727 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.196835 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.196940 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.197074 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":52,"thread_start_us":242,"threads_started":1}
I20260811 14:58:46.197377 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.188677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60484 (local address 127.11.225.126:46185)
0811 14:58:46.188810 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.188815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.189286 (+ 471us) server_negotiation.cc:407] Connection header received
0811 14:58:46.189451 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.189453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.189496 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.189583 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.190219 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.191051 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.191915 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.192133 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.192238 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.193503 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.193514 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.193517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.193545 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.195331 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.195916 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.195920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.195922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.196013 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.196324 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.196328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.196330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.196566 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.196640 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.197022 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.197157 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:58:46.198269 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.188887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40160)
0811 14:58:46.189183 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.189199 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.189319 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.189596 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.189599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.189893 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.190091 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.190100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.192098 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.192101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.193027 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.193039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.193638 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.193642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.193733 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.194703 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.194714 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.195015 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.196746 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.196752 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.196754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.196973 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.197313 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.197316 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.197318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.197397 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.197819 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.197821 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.197915 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.198019 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.198148 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":36,"spinlock_wait_cycles":3840,"thread_start_us":102,"threads_started":1}
I20260811 14:58:46.198999 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.188762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40160 (local address 127.11.225.125:43253)
0811 14:58:46.188882 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.188888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.189291 (+ 403us) server_negotiation.cc:407] Connection header received
0811 14:58:46.189426 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.189429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.189478 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.189565 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.191212 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.191974 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.193157 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.193522 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.193627 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.195158 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.195162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.195164 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.195186 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.196639 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.197085 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.197088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.197089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.197168 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.197497 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.197502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.197504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.197682 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.197738 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.198761 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.198866 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.126@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
I20260811 14:58:46.211381 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.202337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40170 (local address 127.11.225.125:43253)
0811 14:58:46.202427 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.202431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.202742 (+ 311us) server_negotiation.cc:407] Connection header received
0811 14:58:46.202913 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.202916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.202964 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.203045 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.203623 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.204349 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.205375 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.205716 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.205815 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.207885 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.207889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.207891 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.207916 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.209355 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.209775 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.209778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.209779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.209862 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.210336 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.210342 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.210346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.210614 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.210730 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.211114 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.211230 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 14:58:46.211388 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.202292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40170)
0811 14:58:46.202616 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.202665 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.202788 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.203112 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.203117 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.203422 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.203518 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.203523 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.204450 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.204453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.205205 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.205249 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.205816 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.205818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.205894 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.206425 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.206436 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.207757 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.209453 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.209461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.209465 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.209686 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.210063 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.210067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.210069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.210197 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.210739 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.210746 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.210876 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.211033 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.211216 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":103,"threads_started":1}
I20260811 14:58:46.214987 22645 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.225.125:43253: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "72808cdfce23462ebd93e82096b4e944"
member_type: NON_VOTER
last_known_addr {
host: "127.11.225.125"
port: 43253
}
attrs {
promote: true
}
}
dest_uuid: "26b69f7bdc9f466cb34829df09732245"
cas_config_opid_index: -1
I20260811 14:58:46.215754 22645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } }
I20260811 14:58:46.218160 23654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 72808cdfce23462ebd93e82096b4e944 (127.11.225.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } }
I20260811 14:58:46.218930 23568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:46.219909 23654 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.225.125:43253
I20260811 14:58:46.220111 23654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } }
I20260811 14:58:46.220212 23654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:46.220625 23568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 14:58:46.221596 23652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:46.221844 23486 master.cc:537] Master@127.11.225.125:43253 shutting down...
WARNING: no policy specified for oryx/127.11.225.124@KRBTEST.COM; defaulting to no policy
W20260811 14:58:46.223925 22615 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 14:58:46.225008 22615 consensus_peers.cc:487] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 -> Peer 72808cdfce23462ebd93e82096b4e944 (127.11.225.125:43253): Couldn't send request to peer 72808cdfce23462ebd93e82096b4e944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.124@KRBTEST.COM" created.
I20260811 14:58:46.227125 23486 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:46.227459 23486 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:46.227607 23486 tablet_replica.cc:330] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: stopping tablet replica
I20260811 14:58:46.243250 23486 master.cc:552] Master@127.11.225.125:43253 shutdown complete.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.124.keytab.
Entry for principal oryx/127.11.225.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.124.keytab.
I20260811 14:58:46.243312 23486 master_runner.cc:305] Clearing existing system tablet
I20260811 14:58:46.243577 23486 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.243636 23486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.244166 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:41433
--webserver_interface=127.11.225.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.124.keytab
--principal=oryx/127.11.225.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:58:46.245019 23486 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:46.245986 23671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.246199 23486 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.246366 23486 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:46.246415 23486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "72808cdfce23462ebd93e82096b4e944"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "117a1ae798369c3f8ecded855934b156"
server_key_iv: "082dd372c33a64db64fab38fa2f07b4b"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.248942 23486 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:46.252318 23486 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 14:58:46.252430 23486 log.cc:1196] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 14:58:46.252729 23486 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Deleting consensus metadata
I20260811 14:58:46.252931 23486 master_runner.cc:315] Copying system tablet from 127.11.225.126:46185
I20260811 14:58:46.254515 23486 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: tablet copy: Beginning tablet copy session from remote peer at address 127.11.225.126:46185
I20260811 14:58:46.264279 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.255608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60486 (local address 127.11.225.126:46185)
0811 14:58:46.255724 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.255729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.255779 (+ 50us) server_negotiation.cc:407] Connection header received
0811 14:58:46.255975 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.255979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.256036 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.256118 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.256759 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.257627 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.258912 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.259249 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.259354 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.260626 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.260630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.260633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.260661 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.262480 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.263003 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.263007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.263008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.263101 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.263397 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.263400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.263402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.263628 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.263728 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.264002 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.264122 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:58:46.264283 23685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.255238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60486)
0811 14:58:46.255679 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.255699 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.255845 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.256180 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.256185 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.256422 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.256600 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.256613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.257760 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.257767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.258766 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.258778 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.259362 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.259365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.259466 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.260049 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.260063 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.260477 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.262617 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.262620 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.262623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.262878 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.263201 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.263204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.263206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.263302 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.263726 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.263729 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.263826 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.263930 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.264076 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":86,"threads_started":1}
I20260811 14:58:46.265252 22682 tablet_copy_service.cc:140] P 26b69f7bdc9f466cb34829df09732245: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 72808cdfce23462ebd93e82096b4e944 ({username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:60486)
I20260811 14:58:46.265446 22682 tablet_copy_service.cc:161] P 26b69f7bdc9f466cb34829df09732245: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 72808cdfce23462ebd93e82096b4e944 at {username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:60486: session id = 72808cdfce23462ebd93e82096b4e944-00000000000000000000000000000000
I20260811 14:58:46.267369 22682 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 14:58:46.269241 23486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 14:58:46.271603 23486 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: tablet copy: Starting download of 0 data blocks...
I20260811 14:58:46.271812 23486 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: tablet copy: Starting download of 1 WAL segments...
I20260811 14:58:46.273746 23486 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 14:58:46.275465 22682 tablet_copy_service.cc:342] P 26b69f7bdc9f466cb34829df09732245: Request end of tablet copy session 72808cdfce23462ebd93e82096b4e944-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:60486
I20260811 14:58:46.275586 22682 tablet_copy_service.cc:433] P 26b69f7bdc9f466cb34829df09732245: ending tablet copy session 72808cdfce23462ebd93e82096b4e944-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 72808cdfce23462ebd93e82096b4e944
I20260811 14:58:46.284237 23486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.285938 23686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.286193 23688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.286460 23692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.292428 23486 server_base.cc:1034] running on GCE node
I20260811 14:58:46.292614 23486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.292908 23486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.294066 23486 hybrid_clock.cc:648] HybridClock initialized: now 1786460326294052 us; error 34 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.295764 23486 init.cc:377] Logged in from keytab as oryx/127.11.225.125@KRBTEST.COM (short username oryx)
I20260811 14:58:46.296281 23486 webserver.cc:460] Webserver started at http://127.11.225.125:42869/ using document root <none> and password file <none>
I20260811 14:58:46.296494 23486 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.296546 23486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.298127 23486 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 14:58:46.299228 23706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.299480 23486 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:46.299607 23486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "72808cdfce23462ebd93e82096b4e944"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "117a1ae798369c3f8ecded855934b156"
server_key_iv: "082dd372c33a64db64fab38fa2f07b4b"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.299782 23486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.320747 23486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:46.323258 23486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:46.329547 23486 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.125:43253
I20260811 14:58:46.329587 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.125:43253 every 8 connection(s)
I20260811 14:58:46.330399 23486 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
I20260811 14:58:46.332489 23803 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:58:46.333530 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Bootstrap starting.
I20260811 14:58:46.345069 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:58:46.345392 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Bootstrap complete.
I20260811 14:58:46.345996 23803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } }
I20260811 14:58:46.346171 23803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72808cdfce23462ebd93e82096b4e944, State: Initialized, Role: LEARNER
I20260811 14:58:46.346306 23803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } }
I20260811 14:58:46.346649 23807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } }
I20260811 14:58:46.346855 23803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:46.346992 23807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:58:46.351763 23825 catalog_manager.cc:1259] Loaded cluster ID: 1dd8a1add5484ec6b30062d5c21fba96
I20260811 14:58:46.351828 23825 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: loading cluster ID for follower catalog manager: success
I20260811 14:58:46.354102 23825 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: acquiring CA information for follower catalog manager: success
I20260811 14:58:46.355767 23825 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 14:58:46.379730 23669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:46.380066 23669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:46.380142 23669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:46.384186 23669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:46.384254 23669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:46.384289 23669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:46.384338 23669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:46.384380 23669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:46.389573 23669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.124.keytab
--principal=oryx/127.11.225.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:41433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.225.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:46.390538 23669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:46.391583 23669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.400107 23833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.400141 23830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.400239 23669 server_base.cc:1034] running on GCE node
W20260811 14:58:46.400202 23835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.401051 23669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.402419 23669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.403652 23669 hybrid_clock.cc:648] HybridClock initialized: now 1786460326403616 us; error 44 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.406991 23669 init.cc:377] Logged in from keytab as oryx/127.11.225.124@KRBTEST.COM (short username oryx)
I20260811 14:58:46.407956 23669 webserver.cc:460] Webserver started at http://127.11.225.124:37791/ using document root <none> and password file <none>
I20260811 14:58:46.408547 23669 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.408618 23669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.408841 23669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:46.411042 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/instance:
uuid: "95d569be2ad447ab94ac2e16517591d9"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "e10049c3d46701c1d43896ede41f2ab8"
server_key_iv: "dedc8fbf0f3670cdbd3b5e0f4227a2d5"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.411664 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal/instance:
uuid: "95d569be2ad447ab94ac2e16517591d9"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "e10049c3d46701c1d43896ede41f2ab8"
server_key_iv: "dedc8fbf0f3670cdbd3b5e0f4227a2d5"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.415535 23669 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:46.418025 23844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.419191 23669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:46.419329 23669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "95d569be2ad447ab94ac2e16517591d9"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "e10049c3d46701c1d43896ede41f2ab8"
server_key_iv: "dedc8fbf0f3670cdbd3b5e0f4227a2d5"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.419437 23669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.428799 22985 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
I20260811 14:58:46.471483 23669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:46.475174 23669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:46.475395 23669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:46.483345 23669 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.124:41433
I20260811 14:58:46.483639 23939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.124:41433 every 8 connection(s)
I20260811 14:58:46.484424 23669 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
I20260811 14:58:46.487237 23940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:46.490908 23940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } has no permanent_uuid. Determining permanent_uuid...
I20260811 14:58:46.494453 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 23669
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.124@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
I20260811 14:58:46.504704 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.492784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60498 (local address 127.11.225.126:46185)
0811 14:58:46.492913 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.492917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.493735 (+ 818us) server_negotiation.cc:407] Connection header received
0811 14:58:46.494756 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.494760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.494812 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.494893 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.496221 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.496778 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.497924 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.498148 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.498256 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.500722 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.500729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.500735 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.500775 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.502568 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.503063 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.503068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.503089 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.503194 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.503569 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.503573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.503574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.503765 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.503874 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.504413 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.504509 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:46.505712 23943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.493092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60498)
0811 14:58:46.493569 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.493612 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.494508 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.495095 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.495102 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.495596 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.496074 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.496087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.496928 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.496930 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.497791 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.497801 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.498293 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.498297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.498465 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.499002 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.499018 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.500529 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.502696 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.502704 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.502711 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.502959 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.503295 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.503297 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.503298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.503430 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.503873 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.503880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.504140 (+ 260us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.504377 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.504724 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":150,"threads_started":1}
I20260811 14:58:46.506134 23944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.495345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.11.225.124:41433)
0811 14:58:46.495714 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.495725 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.495745 (+ 20us) server_negotiation.cc:407] Connection header received
0811 14:58:46.495782 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.495786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.495936 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.496143 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.497003 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.497921 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.498828 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.499200 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.499324 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.502340 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.502349 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.502364 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.502406 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.504166 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.504679 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.504685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.504687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.504778 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.505097 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.505099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.505100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.505384 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.505638 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.505773 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.505937 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":153,"threads_started":1}
I20260811 14:58:46.506945 23940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.124@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
I20260811 14:58:46.515213 23943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.507431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40184)
0811 14:58:46.507584 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.507597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.507664 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.507988 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.507990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.508125 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.508234 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.508239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.509173 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.509179 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.509763 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.509772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.510299 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.510302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.510401 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.510898 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.510910 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.512251 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.513997 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.514000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.514001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.514193 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.514454 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.514456 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.514457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.514530 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.514870 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.514872 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.514945 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.515022 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.515112 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 14:58:46.515409 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.507532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40184 (local address 127.11.225.125:43253)
0811 14:58:46.507770 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.507773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.507785 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:46.507820 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.507822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.507859 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.507933 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.508385 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.509060 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.509899 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.510183 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.510289 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.512392 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.512395 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.512397 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.512422 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.513888 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.514280 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.514283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.514284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.514373 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.514607 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.514610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.514611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.514789 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.514869 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.515084 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.515191 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260811 14:58:46.516104 23940 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.124@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
I20260811 14:58:46.523303 23943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.516515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.0.0.1:44614)
0811 14:58:46.516652 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.516665 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.516728 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.516881 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.516883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.517025 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.517094 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.517099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.517806 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.517809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.518336 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.518345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.518767 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.518770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.518830 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.519202 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.519213 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.520356 (+ 1143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.521930 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.521933 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.521934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.522140 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.522375 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.522377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.522379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.522453 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.522800 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.522803 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.522886 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.522989 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.523127 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 14:58:46.523303 23944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.516648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44614 (local address 127.11.225.124:41433)
0811 14:58:46.516733 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.516736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.516749 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:46.516780 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.516781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.516812 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.516871 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.517188 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.517693 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.518445 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.518674 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.518743 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.520475 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.520478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.520480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.520500 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.521802 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.522226 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.522228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.522229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.522299 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.522526 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.522528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.522529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.522673 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.522798 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.523043 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.523181 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":23}
I20260811 14:58:46.526763 23940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Bootstrap starting.
I20260811 14:58:46.529063 23940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:46.529815 23940 log.cc:824] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:46.531778 23940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: No bootstrap required, opened a new log
I20260811 14:58:46.535105 23940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } }
I20260811 14:58:46.535301 23940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:46.535358 23940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d569be2ad447ab94ac2e16517591d9, State: Initialized, Role: FOLLOWER
I20260811 14:58:46.535810 23940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } }
I20260811 14:58:46.536280 23948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } } }
I20260811 14:58:46.536428 23948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:46.537015 23940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 14:58:46.541836 23971 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 14:58:46.541936 23971 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 14:58:46.545732 23669 master_runner.cc:428] Detected that this master 95d569be2ad447ab94ac2e16517591d9 is joining an existing cluster
I20260811 14:58:46.545804 23669 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.225.124:41433
I20260811 14:58:46.558285 23987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.548878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.0.0.1:44626)
0811 14:58:46.549743 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.549759 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.549881 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.550190 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.550194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.550424 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.550560 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.550568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.551554 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.551557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.552262 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.552270 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.552770 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.552775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.552879 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.553815 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.553828 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.554249 (+ 421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.556192 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.556197 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.556200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.556417 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.556730 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.556733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.556735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.556858 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.557796 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.557799 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.557889 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.558032 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.558138 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":25,"thread_start_us":107,"threads_started":1}
I20260811 14:58:46.558386 23944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.548929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44626 (local address 127.11.225.124:41433)
0811 14:58:46.549040 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.549045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.549832 (+ 787us) server_negotiation.cc:407] Connection header received
0811 14:58:46.550016 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.550020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.550069 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.550170 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.550685 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.551419 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.552398 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.552624 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.552744 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.554400 (+ 1656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.554407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.554412 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.554440 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.556059 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.556522 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.556526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.556528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.556608 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.557446 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.557450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.557452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.557677 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.557772 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.558096 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.558208 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:58:46.559537 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 22756
I20260811 14:58:46.578227 23985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.548385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40198)
0811 14:58:46.548711 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.548728 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.548897 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.549456 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.549462 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.549794 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.549975 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.549985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.551473 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.551476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.553060 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.553072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.553862 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.553865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.553960 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.554486 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.554501 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.572996 (+ 18495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.576470 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.576473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.576475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.576729 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.577048 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.577051 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.577053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.577138 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.577634 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.577637 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.577733 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.577885 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.578024 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":42,"thread_start_us":117,"threads_started":1}
I20260811 14:58:46.578771 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.548442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40198 (local address 127.11.225.125:43253)
0811 14:58:46.548581 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.548586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.548802 (+ 216us) server_negotiation.cc:407] Connection header received
0811 14:58:46.549041 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.549044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.549136 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.549202 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.550091 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.551099 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.553195 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.553580 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.553667 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.573205 (+ 19538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.573231 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.573234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.573266 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.576340 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.576854 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.576858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.576860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.576947 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.577257 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.577261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.577262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.577480 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.577575 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.578481 (+ 906us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.578624 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 14:58:46.584717 23991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.549354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60510)
0811 14:58:46.553375 (+ 4021us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.553388 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.553537 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.554221 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.554224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.573684 (+ 19460us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.573815 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.573823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.575428 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.575431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.578668 (+ 3237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.578682 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.579480 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.579483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.579626 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.580379 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.580398 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.580844 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.582898 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.582904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.582909 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.583194 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.583516 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.583521 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.583526 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.583632 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.584094 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.584100 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.584224 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.584341 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.584502 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3958,"thread_start_us":117,"threads_started":1}
I20260811 14:58:46.584725 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.549362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.11.225.126:46185)
0811 14:58:46.549477 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.549482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.553461 (+ 3979us) server_negotiation.cc:407] Connection header received
0811 14:58:46.553645 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.553648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.553698 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.553750 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.573988 (+ 20238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.574852 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.578810 (+ 3958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.579210 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.579303 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.581011 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.581015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.581018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.581048 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.582761 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.583307 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.583310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.583312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.583418 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.583740 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.583743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.583745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.583963 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.584080 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.584436 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.584571 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:46.585706 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:44005
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:46185
--webserver_port=34771
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460325, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.126@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
I20260811 14:58:46.599686 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.588647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.0.0.1:44638)
0811 14:58:46.588904 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.588920 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.588997 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.589702 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.589707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.589923 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.590043 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.590054 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.591174 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.591180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.592208 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.592223 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.593055 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.593059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.593181 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.593836 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.593855 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.595590 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.597829 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.597835 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.597839 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.598114 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.598465 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.598472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.598475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.598605 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.599122 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.599128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.599239 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.599353 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.599537 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 14:58:46.600191 23944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.589160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44638 (local address 127.11.225.124:41433)
0811 14:58:46.589313 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.589319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.589333 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:46.589403 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.589409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.589471 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.589558 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.590201 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.591015 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.592385 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.592798 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.592927 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.595773 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.595779 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.595784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.595813 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.597689 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.598246 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.598252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.598254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.598345 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.598722 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.598728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.598733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.598967 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.599070 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.599947 (+ 877us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.600052 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 14:58:46.601058 22645 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.225.124:41433: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "95d569be2ad447ab94ac2e16517591d9"
member_type: NON_VOTER
last_known_addr {
host: "127.11.225.124"
port: 41433
}
attrs {
promote: true
}
}
dest_uuid: "26b69f7bdc9f466cb34829df09732245"
cas_config_opid_index: 5
I20260811 14:58:46.601783 22645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } }
I20260811 14:58:46.603227 23654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.603375 23897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:46.604544 23897 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 14:58:46.604614 23654 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.225.124:41433
I20260811 14:58:46.604779 23654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.604876 23654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:46.605692 23652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:46.606484 23669 master.cc:537] Master@127.11.225.124:41433 shutting down...
W20260811 14:58:46.607913 22615 consensus_peers.cc:487] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 -> Peer 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124:41433): Couldn't send request to peer 95d569be2ad447ab94ac2e16517591d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 14:58:46.610261 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.602993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40210)
0811 14:58:46.603093 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.603108 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.603179 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.605647 (+ 2468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.605650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.605666 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:46.605744 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.605749 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.606942 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.606949 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.608340 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.608353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.609774 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.609779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.609870 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.609915 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.610019 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.610094 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 14:58:46.610669 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.605116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40210 (local address 127.11.225.125:43253)
0811 14:58:46.605288 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.605294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.605309 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:46.605357 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.605360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.605420 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.605524 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:46.605952 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.606795 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.608504 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.609462 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.609580 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.609713 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.610440 (+ 727us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.610547 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:58:46.611668 23758 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 LEARNER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 14:58:46.612206 23652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 14:58:46.612887 23669 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:46.613183 23669 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:46.613322 23669 tablet_replica.cc:330] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: stopping tablet replica
I20260811 14:58:46.614290 23758 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.616624 23807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26b69f7bdc9f466cb34829df09732245. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.616730 23807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:58:46.616823 23807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: NON_VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: true } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.616890 23807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:58:46.618659 23652 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: attempting to promote NON_VOTER 72808cdfce23462ebd93e82096b4e944 to VOTER
I20260811 14:58:46.619087 23652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } }
W20260811 14:58:46.620783 22615 consensus_peers.cc:487] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 -> Peer 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124:41433): Couldn't send request to peer 95d569be2ad447ab94ac2e16517591d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 14:58:46.622196 23758 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 LEARNER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 14:58:46.622545 23997 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 14:58:46.624130 23654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 72808cdfce23462ebd93e82096b4e944 (127.11.225.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.625581 23654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.625707 23654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:46.625834 23654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.625908 23654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:46.625782 23758 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 72808cdfce23462ebd93e82096b4e944 (127.11.225.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.627224 23995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.627354 23995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:46.633165 23669 master.cc:552] Master@127.11.225.124:41433 shutdown complete.
I20260811 14:58:46.633257 23669 master_runner.cc:305] Clearing existing system tablet
I20260811 14:58:46.633492 23669 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.633559 23669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.634829 23669 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:46.635761 24000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.636003 23669 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.636132 23669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:46.636166 23669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "95d569be2ad447ab94ac2e16517591d9"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "e10049c3d46701c1d43896ede41f2ab8"
server_key_iv: "dedc8fbf0f3670cdbd3b5e0f4227a2d5"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.638202 23669 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:46.640522 23669 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 14:58:46.640614 23669 log.cc:1196] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 14:58:46.640856 23669 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Deleting consensus metadata
I20260811 14:58:46.641022 23669 master_runner.cc:315] Copying system tablet from 127.11.225.126:46185
I20260811 14:58:46.642213 23669 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: tablet copy: Beginning tablet copy session from remote peer at address 127.11.225.126:46185
I20260811 14:58:46.652592 24016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.642850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:60520)
0811 14:58:46.643114 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.643128 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.643244 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.643495 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.643499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.643826 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.643958 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.643965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.645073 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.645076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.646085 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.646096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.647048 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.647051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.647147 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.648140 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.648155 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.648627 (+ 472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.650922 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.650926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.650928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.651210 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.651551 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.651554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.651557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.651650 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.652076 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.652079 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.652179 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.652287 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.652420 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260811 14:58:46.652624 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.642826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60520 (local address 127.11.225.126:46185)
0811 14:58:46.642943 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.642948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.643217 (+ 269us) server_negotiation.cc:407] Connection header received
0811 14:58:46.643324 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.643327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.643381 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.643465 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.644097 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.644920 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.646223 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.646588 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.646879 (+ 291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.648775 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.648779 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.648781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.648808 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.650823 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.651324 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.651328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.651329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.651442 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.651757 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.651760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.651762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.651976 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.652075 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.652354 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.652472 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:58:46.653007 22682 tablet_copy_service.cc:140] P 26b69f7bdc9f466cb34829df09732245: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 95d569be2ad447ab94ac2e16517591d9 ({username='oryx', principal='oryx/127.11.225.124@KRBTEST.COM'} at 127.0.0.1:60520)
I20260811 14:58:46.653095 22682 tablet_copy_service.cc:161] P 26b69f7bdc9f466cb34829df09732245: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 95d569be2ad447ab94ac2e16517591d9 at {username='oryx', principal='oryx/127.11.225.124@KRBTEST.COM'} at 127.0.0.1:60520: session id = 95d569be2ad447ab94ac2e16517591d9-00000000000000000000000000000000
I20260811 14:58:46.654191 22682 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 14:58:46.655429 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 14:58:46.657737 23669 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: tablet copy: Starting download of 0 data blocks...
I20260811 14:58:46.657918 23669 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: tablet copy: Starting download of 1 WAL segments...
I20260811 14:58:46.659333 23669 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 14:58:46.661096 22682 tablet_copy_service.cc:342] P 26b69f7bdc9f466cb34829df09732245: Request end of tablet copy session 95d569be2ad447ab94ac2e16517591d9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.225.124@KRBTEST.COM'} at 127.0.0.1:60520
I20260811 14:58:46.661175 22682 tablet_copy_service.cc:433] P 26b69f7bdc9f466cb34829df09732245: ending tablet copy session 95d569be2ad447ab94ac2e16517591d9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 95d569be2ad447ab94ac2e16517591d9
I20260811 14:58:46.667083 23234 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
I20260811 14:58:46.670089 23669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.671705 24022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.671893 24017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.672068 24019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.672665 23669 server_base.cc:1034] running on GCE node
I20260811 14:58:46.672860 23669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.673144 23669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.674283 23669 hybrid_clock.cc:648] HybridClock initialized: now 1786460326674268 us; error 32 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.675982 23669 init.cc:377] Logged in from keytab as oryx/127.11.225.124@KRBTEST.COM (short username oryx)
I20260811 14:58:46.676453 23669 webserver.cc:460] Webserver started at http://127.11.225.124:46037/ using document root <none> and password file <none>
I20260811 14:58:46.676652 23669 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.676695 23669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.678118 23669 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:46.679214 24032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.679473 23669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:46.679598 23669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "95d569be2ad447ab94ac2e16517591d9"
format_stamp: "Formatted at 2026-08-11 14:58:46 on dist-test-slave-8hhm"
server_key: "e10049c3d46701c1d43896ede41f2ab8"
server_key_iv: "dedc8fbf0f3670cdbd3b5e0f4227a2d5"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.679740 23669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.696383 23669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:46.699043 23669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:46.705533 23669 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.124:41433
I20260811 14:58:46.705725 24138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.124:41433 every 8 connection(s)
I20260811 14:58:46.706305 23669 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
I20260811 14:58:46.708308 24140 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:58:46.709435 24140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Bootstrap starting.
I20260811 14:58:46.720569 24140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:58:46.720902 24140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: Bootstrap complete.
I20260811 14:58:46.721566 24140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } }
I20260811 14:58:46.721714 24140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 95d569be2ad447ab94ac2e16517591d9, State: Initialized, Role: LEARNER
I20260811 14:58:46.721827 24140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } }
I20260811 14:58:46.722150 24145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:46.722273 24140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:46.722445 24145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: LEARNER
I20260811 14:58:46.725800 24163 catalog_manager.cc:1259] Loaded cluster ID: 1dd8a1add5484ec6b30062d5c21fba96
I20260811 14:58:46.725921 24163 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: loading cluster ID for follower catalog manager: success
I20260811 14:58:46.728155 24163 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: acquiring CA information for follower catalog manager: success
I20260811 14:58:46.729729 24163 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 14:58:46.740017 23992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:46.740250 23992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:46.740293 23992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:46.744287 23992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:46.744338 23992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:46.744392 23992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:46.750118 23992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:44005
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=34771
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:46.751227 23992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:46.752254 23992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.762032 24174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.762032 24176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.762172 24173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.762519 23992 server_base.cc:1034] running on GCE node
I20260811 14:58:46.762899 23992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.763528 23992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.764727 23992 hybrid_clock.cc:648] HybridClock initialized: now 1786460326764693 us; error 45 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.767454 23992 init.cc:377] Logged in from keytab as oryx/127.11.225.65@KRBTEST.COM (short username oryx)
I20260811 14:58:46.768257 23992 webserver.cc:460] Webserver started at http://127.11.225.65:34771/ using document root <none> and password file <none>
I20260811 14:58:46.768797 23992 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.768906 23992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:46.772516 23992 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:46.774708 24185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.775897 23992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:46.776042 23992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "096ccda90f7f4063b305639d18caf674"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "5dba33aea5c46d51fd3a43f714eecaac"
server_key_iv: "60662e0b350c9b5cf8e7a6995b34564f"
server_key_version: "encryptionkey@0"
I20260811 14:58:46.776577 23992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:46.793558 23992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:46.796322 23992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:46.796543 23992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:46.797138 23992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:46.798008 23992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:46.798076 23992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.798143 23992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:46.798193 23992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:46.807953 23992 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:44005
I20260811 14:58:46.808034 24408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:44005 every 8 connection(s)
I20260811 14:58:46.808949 23992 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:46.813858 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 23992
I20260811 14:58:46.814059 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 22994
I20260811 14:58:46.847564 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:43025
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:46185
--webserver_port=37045
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:46.856617 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.810804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:50631 (local address 127.11.225.125:43253)
0811 14:58:46.810913 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.810916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.812104 (+ 1188us) server_negotiation.cc:407] Connection header received
0811 14:58:46.813324 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.813327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.813384 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.813437 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.840833 (+ 27396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842672 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.843989 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844331 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844406 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.850464 (+ 6058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.850468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.850470 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.850503 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.853040 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854621 (+ 1581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.854624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.854626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.854717 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.855194 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.855198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.855199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.855412 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.855495 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.856319 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.856446 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:58:46.856617 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.810733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:35317 (local address 127.11.225.126:46185)
0811 14:58:46.810875 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.810880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.812105 (+ 1225us) server_negotiation.cc:407] Connection header received
0811 14:58:46.813328 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.813331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.813383 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.813437 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.841333 (+ 27896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842058 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.843990 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844328 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844406 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.851210 (+ 6804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.851214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.851216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.851245 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.853488 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854621 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.854624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.854626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.854717 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.855186 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.855189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.855191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.855412 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.855495 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.856321 (+ 826us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.856446 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:46.856779 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.812585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:34191 (local address 127.11.225.124:41433)
0811 14:58:46.812846 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:46.812851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:46.812865 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:46.813302 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:46.813305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:46.813364 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:46.813446 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:46.841113 (+ 27667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842476 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844065 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844539 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844662 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.851608 (+ 6946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:46.851611 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:46.851613 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:46.851638 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:46.854082 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854795 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.854800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.854805 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.854909 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:46.855280 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:46.855287 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:46.855290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:46.855596 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:46.855685 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:46.856338 (+ 653us) server_negotiation.cc:299] Negotiation successful
0811 14:58:46.856496 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
I20260811 14:58:46.858307 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.812471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.11.225.65:34191)
0811 14:58:46.812767 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.812783 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.813052 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.813654 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.813669 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.839779 (+ 26110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.840961 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.840968 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842648 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.842654 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.843896 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.843911 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844829 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.844999 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.847625 (+ 2626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.847653 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.851458 (+ 3805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.854199 (+ 2741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.854208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.854655 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.855041 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.855044 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.855046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.855157 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.855770 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.855773 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.856001 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.857005 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.857651 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":1545,"spinlock_wait_cycles":10752,"thread_start_us":105,"threads_started":1}
I20260811 14:58:46.858652 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.811364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.11.225.65:50631)
0811 14:58:46.811934 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.811997 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.813071 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.813653 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.813663 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.839877 (+ 26214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.840611 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.840633 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842814 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.842817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.843841 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.843852 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844637 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.845029 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.848048 (+ 3019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.848069 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.850254 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.853164 (+ 2910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.853171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.853189 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.854498 (+ 1309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.854834 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854837 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.854839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.855069 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.855570 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.855577 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.855997 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.857256 (+ 1259us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.857419 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":286,"spinlock_wait_cycles":119296,"thread_start_us":138,"threads_started":1}
I20260811 14:58:46.858829 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:46.811364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:35317)
0811 14:58:46.811934 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:46.811997 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:46.813042 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:46.813653 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:46.813663 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:46.839779 (+ 26116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:46.840613 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.840635 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.842239 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.842242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.843841 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:46.843852 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:46.844637 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:46.844641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:46.845038 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:46.848299 (+ 3261us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:46.848319 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:46.851055 (+ 2736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:46.853621 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.853626 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.853630 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.854505 (+ 875us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.854834 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:46.854837 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:46.854839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:46.855066 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:46.855570 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:46.855577 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:46.855997 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 14:58:46.856876 (+ 879us) client_negotiation.cc:240] Negotiation successful
0811 14:58:46.857303 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":257,"spinlock_wait_cycles":25984,"thread_start_us":146,"threads_started":1}
I20260811 14:58:46.860083 24409 heartbeater.cc:347] Connected to a master server at 127.11.225.124:41433
I20260811 14:58:46.860117 24413 heartbeater.cc:347] Connected to a master server at 127.11.225.125:43253
I20260811 14:58:46.860378 24413 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:46.860381 24409 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:46.860939 24413 heartbeater.cc:511] Master 127.11.225.125:43253 requested a full tablet report, sending...
I20260811 14:58:46.860944 24409 heartbeater.cc:511] Master 127.11.225.124:41433 requested a full tablet report, sending...
I20260811 14:58:46.860100 24410 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:46.861593 24410 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:46.861804 24410 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:46.862531 23742 ts_manager.cc:194] Registered new tserver with Master: 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
I20260811 14:58:46.862531 24056 ts_manager.cc:194] Registered new tserver with Master: 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
I20260811 14:58:46.863616 22645 ts_manager.cc:194] Re-registered known tserver with Master: 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
I20260811 14:58:46.864384 22645 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:35317
I20260811 14:58:46.898499 23475 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
W20260811 14:58:46.968868 24428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:46.969096 24428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:46.969164 24428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:46.973063 24428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:46.973165 24428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:46.973312 24428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:46.978399 24428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:43025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=37045
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:46.979377 24428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:46.980545 24428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:46.990365 24435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.990376 24437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:46.990376 24440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:46.990792 24428 server_base.cc:1034] running on GCE node
I20260811 14:58:46.991246 24428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:46.991915 24428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:46.993139 24428 hybrid_clock.cc:648] HybridClock initialized: now 1786460326993118 us; error 33 us; skew 500 ppm
Aug 11 14:58:46 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:46.996172 24428 init.cc:377] Logged in from keytab as oryx/127.11.225.66@KRBTEST.COM (short username oryx)
I20260811 14:58:46.997157 24428 webserver.cc:460] Webserver started at http://127.11.225.66:37045/ using document root <none> and password file <none>
I20260811 14:58:46.997787 24428 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:46.997907 24428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:47.002360 24428 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:47.004434 24454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.005776 24428 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:47.005899 24428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "b31d880db8f346ddb6768cc16a9adf9c"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "3b94e5dd91fd855d157095420440d453"
server_key_iv: "f478ad060ce0f82263e6801aaf246d16"
server_key_version: "encryptionkey@0"
I20260811 14:58:47.006589 24428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:47.020001 24428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:47.023365 24428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:47.023545 24428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:47.024174 24428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:47.025136 24428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:47.025259 24428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.025344 24428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:47.025375 24428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.036231 24428 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:43025
I20260811 14:58:47.036248 24681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:43025 every 8 connection(s)
I20260811 14:58:47.037433 24428 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:47.045799 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 24428
I20260811 14:58:47.045970 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 23239
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460326, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:47.062206 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.039348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:50639 (local address 127.11.225.125:43253)
0811 14:58:47.039550 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.039556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.040418 (+ 862us) server_negotiation.cc:407] Connection header received
0811 14:58:47.041952 (+ 1534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.041955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.042003 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.042111 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.043590 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044343 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046078 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046482 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046580 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.056168 (+ 9588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.056172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.056175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.056212 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.059110 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.059934 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.059941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.059946 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.060047 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060530 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.060545 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.060549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.060821 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.060909 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.061782 (+ 873us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.061926 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 14:58:47.062229 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.041049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:58487 (local address 127.11.225.124:41433)
0811 14:58:47.041193 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.041200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.041312 (+ 112us) server_negotiation.cc:407] Connection header received
0811 14:58:47.042241 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.042244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.042293 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.042377 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.043561 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044169 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046078 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046497 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046580 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.051960 (+ 5380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.051969 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.051976 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.052021 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.055934 (+ 3913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060400 (+ 4466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.060406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.060412 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.060547 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060926 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.060930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.060932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.061202 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.061340 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.061809 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.061972 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:58:47.062530 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.039542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:57333 (local address 127.11.225.126:46185)
0811 14:58:47.039684 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.039690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.040413 (+ 723us) server_negotiation.cc:407] Connection header received
0811 14:58:47.041840 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.041844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.041918 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.042059 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.043503 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044367 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.045694 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046044 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046144 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.058044 (+ 11900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.058049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.058052 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.058090 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.060303 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060839 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.060847 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.060851 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.060965 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.061365 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.061369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.061371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.061627 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.061732 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.062177 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.062341 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:58:47.064344 24695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.039767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.11.225.66:50639)
0811 14:58:47.040256 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.040311 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.041601 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.042272 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.042274 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.042899 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.043367 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.043376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044491 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.044495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.045903 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.045916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046813 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046821 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.046993 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.047738 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.047760 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.055936 (+ 8176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.059280 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.059294 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.059320 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.059794 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.060167 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060173 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.060178 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.060393 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.061099 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.061108 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.061474 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.062543 (+ 1069us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.063024 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":314,"spinlock_wait_cycles":17664,"thread_start_us":202,"threads_started":1}
I20260811 14:58:47.064343 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.040866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.11.225.66:58487)
0811 14:58:47.041192 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.041225 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.041597 (+ 372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.042418 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.042422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.042899 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.043365 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.043376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044365 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.044368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.045905 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.045916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046838 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.046998 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.047553 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.047572 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.051667 (+ 4095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.059936 (+ 8269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.059939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.059941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.060257 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.060693 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.060699 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.060800 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.061406 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.061412 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.061534 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.062534 (+ 1000us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.063193 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":478,"spinlock_wait_cycles":17408,"thread_start_us":149,"threads_started":1}
I20260811 14:58:47.065120 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.039766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:57333)
0811 14:58:47.040255 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.040310 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.041596 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.042264 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.042272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.042795 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.043349 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.043363 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.044519 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.044523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.045540 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.045554 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.046443 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.046450 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.046728 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.047917 (+ 1189us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.047940 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.057789 (+ 9849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.060443 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.060447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.060449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.060709 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.061108 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.061111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.061113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.061203 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.061798 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.061801 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.061892 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.062698 (+ 806us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.063125 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":203,"spinlock_wait_cycles":19200,"thread_start_us":130,"threads_started":1}
I20260811 14:58:47.065896 24683 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:47.066045 24685 heartbeater.cc:347] Connected to a master server at 127.11.225.125:43253
I20260811 14:58:47.066130 24682 heartbeater.cc:347] Connected to a master server at 127.11.225.124:41433
I20260811 14:58:47.066159 24685 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.066161 24683 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.066187 24682 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.066821 24683 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:47.066799 24682 heartbeater.cc:511] Master 127.11.225.124:41433 requested a full tablet report, sending...
I20260811 14:58:47.066815 24685 heartbeater.cc:511] Master 127.11.225.125:43253 requested a full tablet report, sending...
I20260811 14:58:47.068109 22645 ts_manager.cc:194] Re-registered known tserver with Master: b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025)
I20260811 14:58:47.068419 23742 ts_manager.cc:194] Registered new tserver with Master: b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025)
I20260811 14:58:47.069024 22645 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:57333
I20260811 14:58:47.069365 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:38811
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:46185
--webserver_port=34523
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:58:47.069705 24056 ts_manager.cc:194] Registered new tserver with Master: b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025)
I20260811 14:58:47.170522 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.166535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.0.0.1:44648)
0811 14:58:47.166789 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.166804 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.166911 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.167233 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.167235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.167252 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.167350 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.167355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.168385 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.168387 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.169267 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.169280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.170193 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.170195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.170266 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.170288 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.170336 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.170395 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260811 14:58:47.170586 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.166644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.11.225.124:41433)
0811 14:58:47.166792 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.166797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.166890 (+ 93us) server_negotiation.cc:407] Connection header received
0811 14:58:47.167020 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.167023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.167094 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.167216 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.167467 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.168276 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.169403 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.170076 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.170203 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.170349 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.170382 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.170447 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 14:58:47.171315 24076 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 14:58:47.171730 24145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26b69f7bdc9f466cb34829df09732245. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:47.171916 24145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: LEARNER
W20260811 14:58:47.186208 24697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:47.186486 24697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:47.186559 24697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:47.190761 24697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:47.190835 24697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:47.190923 24697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:47.196242 24697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:38811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=34523
--tserver_master_addrs=127.11.225.126:46185,127.11.225.125:43253,127.11.225.124:41433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:47.197393 24697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:47.198396 24697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:47.208356 24710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:47.208341 24707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:47.208496 24697 server_base.cc:1034] running on GCE node
W20260811 14:58:47.208364 24712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:47.208984 24697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:47.209690 24697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:47.210872 24697 hybrid_clock.cc:648] HybridClock initialized: now 1786460327210853 us; error 28 us; skew 500 ppm
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460327, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:47.213794 24697 init.cc:377] Logged in from keytab as oryx/127.11.225.67@KRBTEST.COM (short username oryx)
I20260811 14:58:47.214776 24697 webserver.cc:460] Webserver started at http://127.11.225.67:34523/ using document root <none> and password file <none>
I20260811 14:58:47.215350 24697 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:47.215447 24697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:47.219360 24697 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:47.221423 24735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.222718 24697 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:47.222846 24697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "7ea5cbdba68343e89c50485c174a3a88"
format_stamp: "Formatted at 2026-08-11 14:58:45 on dist-test-slave-8hhm"
server_key: "927bc0577db7289a493346aff3e0904e"
server_key_iv: "d32115829a32672fed1928acfb0ecc78"
server_key_version: "encryptionkey@0"
I20260811 14:58:47.223500 24697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:47.248231 24697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:47.251490 24697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:47.251689 24697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:47.252404 24697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:47.253307 24697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:47.253374 24697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.253443 24697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:47.253489 24697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:47.262804 24697 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:38811
I20260811 14:58:47.262825 24977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:38811 every 8 connection(s)
I20260811 14:58:47.263827 24697 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:47.266593 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 24697
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460327, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.124@KRBTEST.COM
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460327, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.125@KRBTEST.COM
Aug 11 14:58:47 dist-test-slave-8hhm krb5kdc[22570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460327, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:47.284474 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.269432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.11.225.124:41433)
0811 14:58:47.270242 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.270246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.270260 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:47.270297 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.270300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.270339 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.271212 (+ 873us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.272548 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.273299 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.274466 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.274824 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.276864 (+ 2040us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.278413 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.278417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.278419 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.278448 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.281913 (+ 3465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.282433 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.282437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.282439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.282527 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.282873 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.282877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.282879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.283114 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.283987 (+ 873us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.284084 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.284211 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":102,"threads_started":1}
I20260811 14:58:47.284987 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.267373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:58161 (local address 127.11.225.124:41433)
0811 14:58:47.267564 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.267569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.267780 (+ 211us) server_negotiation.cc:407] Connection header received
0811 14:58:47.268385 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.268389 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.268454 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.268517 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.270543 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.271383 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.273047 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.273385 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.273458 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.276555 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.276559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.276562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.276588 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.278975 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.279686 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.279689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.279691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.279784 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.280254 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.280257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.280259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.280518 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.280630 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.284753 (+ 4123us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.284862 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260811 14:58:47.285121 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.266186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.11.225.67:52123)
0811 14:58:47.266711 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.266764 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.268123 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.268825 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.268834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.269543 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.270369 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.270391 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.271515 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.271521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.273570 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.273580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.275794 (+ 2214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.275798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.276012 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.276473 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.276488 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.278366 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.281829 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.281832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.281833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.282105 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.282625 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.282628 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.282630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.282722 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.283225 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.283230 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.283376 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.283584 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.283919 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":1017,"spinlock_wait_cycles":29952,"thread_start_us":165,"threads_started":1}
I20260811 14:58:47.285988 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.265743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:52123 (local address 127.11.225.125:43253)
0811 14:58:47.265886 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.265890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.266881 (+ 991us) server_negotiation.cc:407] Connection header received
0811 14:58:47.268445 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.268448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.268501 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.268570 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.270535 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.271349 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.273696 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.274026 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.274451 (+ 425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.278640 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.278646 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.278651 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.278680 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.281622 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.282413 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.282417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.282418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.282509 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.282827 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.282830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.282832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.283068 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.283170 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.285677 (+ 2507us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.285819 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 14:58:47.286036 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.267256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.11.225.67:58161)
0811 14:58:47.267697 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.267710 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.268143 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.268826 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.268835 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.269549 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.270368 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.270391 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.271523 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.271526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.272898 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.272908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.273656 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.273660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.273862 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.274499 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.274520 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.276384 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.279090 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.279097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.279113 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.279559 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.279915 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.279918 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.279920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.280125 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.280715 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.280722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.284548 (+ 3826us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.285170 (+ 622us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.285336 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":84,"spinlock_wait_cycles":1792,"thread_start_us":85,"threads_started":1}
I20260811 14:58:47.286965 24978 heartbeater.cc:347] Connected to a master server at 127.11.225.124:41433
I20260811 14:58:47.287057 24980 heartbeater.cc:347] Connected to a master server at 127.11.225.125:43253
I20260811 14:58:47.287222 24980 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.287222 24978 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.287882 24980 heartbeater.cc:511] Master 127.11.225.125:43253 requested a full tablet report, sending...
I20260811 14:58:47.288102 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.269727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40214 (local address 127.11.225.125:43253)
0811 14:58:47.270386 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.270390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.270403 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:47.270442 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.270448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.270508 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.271511 (+ 1003us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.271633 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.272406 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.276050 (+ 3644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.276384 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.277038 (+ 654us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.278682 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.278688 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.278695 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.278731 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.286387 (+ 7656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.286844 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.286846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.286847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.286914 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.287200 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.287203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.287205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.287433 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.287569 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.287806 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.287929 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":82,"threads_started":1}
I20260811 14:58:47.287882 24978 heartbeater.cc:511] Master 127.11.225.124:41433 requested a full tablet report, sending...
I20260811 14:58:47.289094 23739 ts_manager.cc:194] Registered new tserver with Master: 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:47.289278 24056 ts_manager.cc:194] Registered new tserver with Master: 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:47.289726 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.266186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:34895)
0811 14:58:47.267043 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.267056 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.268123 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.268825 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.268834 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.271350 (+ 2516us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:47.271488 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.271495 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.274570 (+ 3075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.274574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.275381 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.275391 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.276589 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.276593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.276696 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.279196 (+ 2500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:47.279214 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:47.282926 (+ 3712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:47.285536 (+ 2610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.285541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.285545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.285798 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.288571 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:47.288573 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:47.288575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:47.288679 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:47.289177 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:47.289180 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:47.289290 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.289386 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.289538 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":23,"spinlock_wait_cycles":80256,"thread_start_us":178,"threads_started":1}
I20260811 14:58:47.290202 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.265828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:34895 (local address 127.11.225.126:46185)
0811 14:58:47.266000 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.266004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.267126 (+ 1122us) server_negotiation.cc:407] Connection header received
0811 14:58:47.268366 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.268369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.268430 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.268486 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.271851 (+ 3365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.272657 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.275504 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.276078 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.276463 (+ 385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.283126 (+ 6663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.283129 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.283134 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.283205 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.285426 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.285903 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.285906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.285908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.285985 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.288798 (+ 2813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.288801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.288803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.289015 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.289114 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.289945 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.290075 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":173,"server-negotiator.queue_time_us":82}
I20260811 14:58:47.290791 24979 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46185
I20260811 14:58:47.290910 24979 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:47.291100 24979 heartbeater.cc:511] Master 127.11.225.126:46185 requested a full tablet report, sending...
I20260811 14:58:47.291785 22645 ts_manager.cc:194] Re-registered known tserver with Master: 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:47.291998 25011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.269996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60526 (local address 127.11.225.126:46185)
0811 14:58:47.270244 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.270248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.271819 (+ 1571us) server_negotiation.cc:407] Connection header received
0811 14:58:47.271982 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.271985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.272034 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.272094 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.273009 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.273743 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.274861 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.275217 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.275285 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.279460 (+ 4175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.279464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.279466 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.279548 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.285261 (+ 5713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.290663 (+ 5402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.290669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.290674 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.290775 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.291078 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.291081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.291083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.291298 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.291439 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.291659 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.291769 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
I20260811 14:58:47.292461 22645 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:34895
I20260811 14:58:47.294699 22645 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:47.297685 22645 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:47.300307 23997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: NON_VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: true } } }
I20260811 14:58:47.300441 23997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:47.303938 23997 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: attempting to promote NON_VOTER 95d569be2ad447ab94ac2e16517591d9 to VOTER
I20260811 14:58:47.304283 23997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } }
I20260811 14:58:47.305727 24076 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 LEARNER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 14:58:47.305823 23758 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Refusing update from remote peer 26b69f7bdc9f466cb34829df09732245: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 14:58:47.306128 25032 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 14:58:47.306243 25016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 14:58:47.308094 25032 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.308583 23758 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.308739 24076 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.309849 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.309994 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:47.310171 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.310251 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:47.310446 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.310542 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:47.311206 24145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.311333 24145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:47.311368 25034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26b69f7bdc9f466cb34829df09732245" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:47.311514 25034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:47.318745 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.313873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:43025 (local address 127.0.0.1:46718)
0811 14:58:47.314012 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.314030 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.314112 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.314808 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.314811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.314832 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.314943 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.314949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.316052 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.316055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.317261 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.317272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318345 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.318348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.318438 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.318465 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.318512 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.318601 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 14:58:47.319103 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.313898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44005 (local address 127.0.0.1:52738)
0811 14:58:47.314932 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.314946 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.315050 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.315471 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.315474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.315492 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.315596 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.315605 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.316880 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.316883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.317825 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.317833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318700 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.318703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.318798 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.318828 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.318896 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.318980 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":857,"mutex_wait_us":27,"thread_start_us":86,"threads_started":1}
I20260811 14:58:47.319164 25040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.314163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52738 (local address 127.11.225.65:44005)
0811 14:58:47.314451 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.314466 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.315029 (+ 563us) server_negotiation.cc:407] Connection header received
0811 14:58:47.315166 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.315172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.315341 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.315492 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.315691 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.316740 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.317940 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318594 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.318706 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.318863 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.318921 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.319014 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260811 14:58:47.319442 25035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.313496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46718 (local address 127.11.225.66:43025)
0811 14:58:47.314252 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.314282 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.314311 (+ 29us) server_negotiation.cc:407] Connection header received
0811 14:58:47.314398 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.314403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.314623 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.315107 (+ 484us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.315233 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.315942 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.317370 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318210 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.319006 (+ 796us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.319152 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.319211 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.319308 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":140,"threads_started":1}
I20260811 14:58:47.321978 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.314268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:38811 (local address 127.0.0.1:36212)
0811 14:58:47.316188 (+ 1920us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.316202 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.316687 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.317141 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.317144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.317169 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.317339 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.317348 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318623 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.318629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.320355 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.320365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.321588 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.321592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.321680 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.321704 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.321784 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.321848 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1856,"mutex_wait_us":22,"thread_start_us":85,"threads_started":1}
I20260811 14:58:47.322232 25042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.314668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36212 (local address 127.11.225.67:38811)
0811 14:58:47.315022 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.315036 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.316642 (+ 1606us) server_negotiation.cc:407] Connection header received
0811 14:58:47.316848 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.316853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.317013 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.317161 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.317469 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.318509 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.320483 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.321291 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.321394 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.321521 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.321822 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.321919 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":135,"threads_started":1}
I20260811 14:58:47.322211 24550 tablet_service.cc:1467] Processing CreateTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 (DEFAULT_TABLE table=test-table [id=8436668ed1c0472abbb96a8140b10547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:47.322190 24284 tablet_service.cc:1467] Processing CreateTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 (DEFAULT_TABLE table=test-table [id=8436668ed1c0472abbb96a8140b10547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:47.323223 24550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b3e7c380b4d60a372b1eb89265b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:47.323223 24284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b3e7c380b4d60a372b1eb89265b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:47.328130 24845 tablet_service.cc:1467] Processing CreateTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 (DEFAULT_TABLE table=test-table [id=8436668ed1c0472abbb96a8140b10547]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:47.329047 24845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062b3e7c380b4d60a372b1eb89265b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:47.334278 25048 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Bootstrap starting.
I20260811 14:58:47.336175 25048 tablet_bootstrap.cc:654] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:47.337007 25049 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Bootstrap starting.
I20260811 14:58:47.337007 25048 log.cc:824] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:47.339061 25049 tablet_bootstrap.cc:654] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:47.339879 25049 log.cc:824] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:47.341722 25049 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: No bootstrap required, opened a new log
I20260811 14:58:47.341933 25049 ts_tablet_manager.cc:1397] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 14:58:47.342051 25043 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Bootstrap starting.
I20260811 14:58:47.342913 25048 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: No bootstrap required, opened a new log
I20260811 14:58:47.343101 25048 ts_tablet_manager.cc:1397] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260811 14:58:47.344072 25043 tablet_bootstrap.cc:654] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:47.344745 25043 log.cc:824] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:47.346468 25043 tablet_bootstrap.cc:492] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: No bootstrap required, opened a new log
I20260811 14:58:47.346652 25043 ts_tablet_manager.cc:1397] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 14:58:47.346683 25049 raft_consensus.cc:348] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.347029 25049 raft_consensus.cc:374] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:47.347138 25049 raft_consensus.cc:729] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea5cbdba68343e89c50485c174a3a88, State: Initialized, Role: FOLLOWER
I20260811 14:58:47.347637 25049 consensus_queue.cc:260] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.348069 25048 raft_consensus.cc:348] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.348312 25048 raft_consensus.cc:374] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:47.348378 25048 raft_consensus.cc:729] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b31d880db8f346ddb6768cc16a9adf9c, State: Initialized, Role: FOLLOWER
I20260811 14:58:47.348667 25049 ts_tablet_manager.cc:1428] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260811 14:58:47.348805 25048 consensus_queue.cc:260] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.349071 24979 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
I20260811 14:58:47.349897 25048 ts_tablet_manager.cc:1428] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 14:58:47.350270 24683 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
I20260811 14:58:47.351982 25043 raft_consensus.cc:348] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.352239 25043 raft_consensus.cc:374] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:47.352303 25043 raft_consensus.cc:729] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096ccda90f7f4063b305639d18caf674, State: Initialized, Role: FOLLOWER
I20260811 14:58:47.352749 25043 consensus_queue.cc:260] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.353732 25043 ts_tablet_manager.cc:1428] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 14:58:47.354893 24410 heartbeater.cc:503] Master 127.11.225.126:46185 was elected leader, sending a full tablet report...
W20260811 14:58:47.515276 24984 tablet.cc:2369] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:47.520566 25067 raft_consensus.cc:482] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:47.520817 25067 raft_consensus.cc:504] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.522128 25067 leader_election.cc:288] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025), 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:47.526389 25035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.522524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33889 (local address 127.11.225.66:43025)
0811 14:58:47.522660 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.522665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.522895 (+ 230us) server_negotiation.cc:407] Connection header received
0811 14:58:47.523071 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.523077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.523137 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.523221 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.523534 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.524221 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.525390 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.525833 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.525927 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.526006 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.526182 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.526265 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 14:58:47.526412 25069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.522421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:43025 (local address 127.11.225.65:33889)
0811 14:58:47.522801 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.522814 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.522940 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.523271 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.523274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.523295 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.523418 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.523424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.524332 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.524335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.525264 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.525275 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.525966 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.525970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.526054 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.526082 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.526161 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.526240 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":6,"thread_start_us":137,"threads_started":1}
I20260811 14:58:47.526454 25042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.522518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51481 (local address 127.11.225.67:38811)
0811 14:58:47.522660 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.522665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.523089 (+ 424us) server_negotiation.cc:407] Connection header received
0811 14:58:47.523288 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.523291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.523341 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.523422 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:47.523725 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.524433 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.525493 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.525867 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.526003 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.526064 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.526268 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.526341 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:47.527060 25068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.522421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:38811 (local address 127.11.225.65:51481)
0811 14:58:47.522918 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:47.522933 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:47.523164 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:47.523443 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:47.523445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:47.523460 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:47.523574 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.523580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.524556 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.524559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.525381 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:47.525392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.526022 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.526029 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:47.526122 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.526162 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 14:58:47.526239 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:58:47.526299 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":31,"thread_start_us":101,"threads_started":1}
I20260811 14:58:47.527209 24585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b3e7c380b4d60a372b1eb89265b29" candidate_uuid: "096ccda90f7f4063b305639d18caf674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b31d880db8f346ddb6768cc16a9adf9c" is_pre_election: true
I20260811 14:58:47.527549 24585 raft_consensus.cc:2454] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096ccda90f7f4063b305639d18caf674 in term 0.
I20260811 14:58:47.527717 24883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b3e7c380b4d60a372b1eb89265b29" candidate_uuid: "096ccda90f7f4063b305639d18caf674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea5cbdba68343e89c50485c174a3a88" is_pre_election: true
I20260811 14:58:47.528007 24883 raft_consensus.cc:2454] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 096ccda90f7f4063b305639d18caf674 in term 0.
I20260811 14:58:47.528039 24192 leader_election.cc:302] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096ccda90f7f4063b305639d18caf674, b31d880db8f346ddb6768cc16a9adf9c; no voters:
I20260811 14:58:47.528313 25067 raft_consensus.cc:2781] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:47.528404 25067 raft_consensus.cc:482] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:47.528467 25067 raft_consensus.cc:3037] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:47.529567 25067 raft_consensus.cc:504] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.529948 25067 leader_election.cc:288] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [CANDIDATE]: Term 1 election: Requested vote from peers b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025), 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811)
I20260811 14:58:47.530319 24585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b3e7c380b4d60a372b1eb89265b29" candidate_uuid: "096ccda90f7f4063b305639d18caf674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b31d880db8f346ddb6768cc16a9adf9c"
I20260811 14:58:47.530462 24585 raft_consensus.cc:3037] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:47.530462 24883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062b3e7c380b4d60a372b1eb89265b29" candidate_uuid: "096ccda90f7f4063b305639d18caf674" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea5cbdba68343e89c50485c174a3a88"
I20260811 14:58:47.530612 24883 raft_consensus.cc:3037] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:47.531540 24585 raft_consensus.cc:2454] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096ccda90f7f4063b305639d18caf674 in term 1.
I20260811 14:58:47.531754 24883 raft_consensus.cc:2454] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 096ccda90f7f4063b305639d18caf674 in term 1.
I20260811 14:58:47.531806 24192 leader_election.cc:302] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096ccda90f7f4063b305639d18caf674, b31d880db8f346ddb6768cc16a9adf9c; no voters:
I20260811 14:58:47.532008 25067 raft_consensus.cc:2781] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:47.532215 25067 raft_consensus.cc:686] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 1 LEADER]: Becoming Leader. State: Replica: 096ccda90f7f4063b305639d18caf674, State: Running, Role: LEADER
I20260811 14:58:47.532562 25067 consensus_queue.cc:237] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:47.536115 22647 catalog_manager.cc:5495] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 reported cstate change: term changed from 0 to 1, leader changed from <none> to 096ccda90f7f4063b305639d18caf674 (127.11.225.65). New cstate: current_term: 1 leader_uuid: "096ccda90f7f4063b305639d18caf674" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } health_report { overall_health: UNKNOWN } } }
W20260811 14:58:47.539673 24690 tablet.cc:2369] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:47.549961 25040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.546160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.11.225.65:44005)
0811 14:58:47.546283 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.546287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.546303 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:58:47.546492 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.546494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.546544 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.546628 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:47.546915 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.547408 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.548355 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.548627 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.548727 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.549119 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:47.549583 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:47.549719 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.549749 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.549797 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:47.556010 24585 raft_consensus.cc:1261] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Refusing update from remote peer 096ccda90f7f4063b305639d18caf674: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:47.556090 24883 raft_consensus.cc:1261] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Refusing update from remote peer 096ccda90f7f4063b305639d18caf674: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:47.556700 25067 consensus_queue.cc:1035] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:47.556947 25072 consensus_queue.cc:1035] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 14:58:47.561623 24417 tablet.cc:2369] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:47.567631 25078 mvcc.cc:205] Tried to move back new op lower bound from 7317341501662101504 to 7317341501576232960. Current Snapshot: MvccSnapshot[applied={T|T < 7317341501662101504 or (T in {7317341501662101504})}]
I20260811 14:58:47.576241 22647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:47.576380 22647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:47.580466 22647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 26b69f7bdc9f466cb34829df09732245: Sending DeleteTablet for 3 replicas of tablet 062b3e7c380b4d60a372b1eb89265b29
I20260811 14:58:47.581275 24284 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:47 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:52738
I20260811 14:58:47.581506 24550 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:47 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:46718
I20260811 14:58:47.581949 25103 tablet_replica.cc:330] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: stopping tablet replica
I20260811 14:58:47.582275 25103 raft_consensus.cc:2229] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:47.582367 24845 tablet_service.cc:1514] Processing DeleteTablet for tablet 062b3e7c380b4d60a372b1eb89265b29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:47 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:36212
I20260811 14:58:47.582674 25103 raft_consensus.cc:2258] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:47.582916 25104 tablet_replica.cc:330] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: stopping tablet replica
I20260811 14:58:47.583606 25104 raft_consensus.cc:2229] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:47.583894 25104 raft_consensus.cc:2258] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:47.584672 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 22591
I20260811 14:58:47.590199 25101 tablet_replica.cc:330] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: stopping tablet replica
I20260811 14:58:47.590538 25101 raft_consensus.cc:2229] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:47.590929 25101 raft_consensus.cc:2258] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:47.592589 25104 ts_tablet_manager.cc:1905] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:47.593014 25103 ts_tablet_manager.cc:1905] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:47.595443 25104 ts_tablet_manager.cc:1918] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:47.595556 25104 log.cc:1196] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/062b3e7c380b4d60a372b1eb89265b29
I20260811 14:58:47.595873 25104 ts_tablet_manager.cc:1939] T 062b3e7c380b4d60a372b1eb89265b29 P 7ea5cbdba68343e89c50485c174a3a88: Deleting consensus metadata
I20260811 14:58:47.596782 25103 ts_tablet_manager.cc:1918] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:47.598879 25103 log.cc:1196] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/062b3e7c380b4d60a372b1eb89265b29
I20260811 14:58:47.599337 25103 ts_tablet_manager.cc:1939] T 062b3e7c380b4d60a372b1eb89265b29 P b31d880db8f346ddb6768cc16a9adf9c: Deleting consensus metadata
W20260811 14:58:47.601864 24736 connection.cc:535] server connection from 127.0.0.1:36212 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 14:58:47.602391 24457 connection.cc:535] server connection from 127.0.0.1:46718 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 14:58:47.602758 25101 ts_tablet_manager.cc:1905] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:47.605592 25101 ts_tablet_manager.cc:1918] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:47.605700 25101 log.cc:1196] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/062b3e7c380b4d60a372b1eb89265b29
I20260811 14:58:47.606076 25101 ts_tablet_manager.cc:1939] T 062b3e7c380b4d60a372b1eb89265b29 P 096ccda90f7f4063b305639d18caf674: Deleting consensus metadata
W20260811 14:58:47.607404 24191 connection.cc:441] server connection from 127.0.0.1:52738 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52738 (request call id 1) could send its response
I20260811 14:58:47.612598 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.584828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40220 (local address 127.11.225.125:43253)
0811 14:58:47.587625 (+ 2797us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.587629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.597253 (+ 9624us) server_negotiation.cc:407] Connection header received
0811 14:58:47.597513 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.597520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.597597 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.597688 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.600040 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.600935 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.602354 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.602725 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.602803 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.608596 (+ 5793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.608600 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.608635 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.608664 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.610473 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.610973 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.610977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.610979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.611064 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.611352 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.611356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.611358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.611573 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.611998 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.612289 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.612414 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2706}
I20260811 14:58:47.617628 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.607104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44684 (local address 127.11.225.124:41433)
0811 14:58:47.607229 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.607233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.607468 (+ 235us) server_negotiation.cc:407] Connection header received
0811 14:58:47.607678 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.607681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.607739 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.607796 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.609304 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.610032 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.611169 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.611513 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.611590 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.614027 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.614030 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.614033 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.614058 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.615759 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.616263 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.616267 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.616268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.616356 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.616669 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.616672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.616674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.616869 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.616972 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.617342 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.617456 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:47.619589 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.606953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40234 (local address 127.11.225.125:43253)
0811 14:58:47.607095 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.607099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.607113 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:47.607151 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.607154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.607197 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.607270 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.608772 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.609588 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.610793 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.611169 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.611240 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.615428 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.615431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.615434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.615459 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.617306 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.618118 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.618123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.618125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.618220 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.618568 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.618573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.618576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.618815 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.618927 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.619331 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.619443 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:58:47.621245 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:47.584936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44676 (local address 127.11.225.124:41433)
0811 14:58:47.590167 (+ 5231us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:47.590173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:47.612596 (+ 22423us) server_negotiation.cc:407] Connection header received
0811 14:58:47.613267 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:47.613270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:47.613316 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:47.613399 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:47.614067 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.614520 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.615641 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:47.616044 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:47.616127 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:47.617811 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:47.617814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:47.617817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:47.617840 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:47.619588 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.620074 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.620077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.620078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.620158 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:47.620421 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:47.620426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:47.620428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:47.620588 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:47.620722 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:47.620934 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 14:58:47.621062 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5118}
I20260811 14:58:48.568742 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:48.568137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:56545)
0811 14:58:48.568495 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:48.568619 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":86,"threads_started":1}
W20260811 14:58:48.569123 24979 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:46185 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:48.569329 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:48.568470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:37289)
0811 14:58:48.568789 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:48.569093 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":84,"threads_started":1}
W20260811 14:58:48.569722 24683 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:46185 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:48.574235 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:48.573809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:34591)
0811 14:58:48.574089 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:48.574160 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":59,"threads_started":1}
W20260811 14:58:48.574570 24410 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:46185 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:49.081079 25129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26b69f7bdc9f466cb34829df09732245)
I20260811 14:58:49.081449 25129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } }
I20260811 14:58:49.081511 25132 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26b69f7bdc9f466cb34829df09732245)
I20260811 14:58:49.081717 25132 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } }
I20260811 14:58:49.082580 25129 leader_election.cc:288] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185), 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124:41433)
I20260811 14:58:49.082980 25132 leader_election.cc:288] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185), 72808cdfce23462ebd93e82096b4e944 (127.11.225.125:43253)
I20260811 14:58:49.083187 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.082716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32788)
0811 14:58:49.082982 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.083065 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
I20260811 14:58:49.083374 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.082715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32804)
0811 14:58:49.083207 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.083284 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":63,"threads_started":1}
W20260811 14:58:49.083523 24041 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
W20260811 14:58:49.083591 23712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:49.084452 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.084228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32814)
0811 14:58:49.084335 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.084386 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 14:58:49.084496 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.084270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32820)
0811 14:58:49.084395 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.084437 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260811 14:58:49.084602 24041 leader_election.cc:334] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185): Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
W20260811 14:58:49.084645 23712 leader_election.cc:334] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185): Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:49.087234 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.082775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:41433 (local address 127.0.0.1:44700)
0811 14:58:49.083082 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.083096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.083193 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.083643 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.083646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.083663 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.083759 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.083763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.084861 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.084867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.086111 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.086119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.086914 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.086916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.086982 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.087002 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.087086 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.087143 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":61,"threads_started":1}
I20260811 14:58:49.087342 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.082969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44700 (local address 127.11.225.124:41433)
0811 14:58:49.083392 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.083396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.083409 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:49.083455 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.083459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.083512 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.083840 (+ 328us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.083963 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.084709 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.086218 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.086790 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.086929 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.086977 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.087125 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.087191 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":65,"threads_started":1}
I20260811 14:58:49.088052 24076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72808cdfce23462ebd93e82096b4e944" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "95d569be2ad447ab94ac2e16517591d9" is_pre_election: true
I20260811 14:58:49.088263 24076 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72808cdfce23462ebd93e82096b4e944 in term 1.
I20260811 14:58:49.088435 25140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.083214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:43253 (local address 127.0.0.1:40236)
0811 14:58:49.083442 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.083454 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.083535 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.084916 (+ 1381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.084918 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.084935 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.085005 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.085010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.085963 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.085965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.087200 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.087208 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.088044 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.088048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.088135 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.088165 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.088243 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.088316 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":1,"thread_start_us":55,"threads_started":1}
I20260811 14:58:49.088515 25148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.083922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40236 (local address 127.11.225.125:43253)
0811 14:58:49.084388 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.084399 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.084411 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:49.084448 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.084451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.084797 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.084893 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.085108 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.085859 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.087328 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.087930 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.088019 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.088052 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.088301 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.088387 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":414,"thread_start_us":89,"threads_started":1}
I20260811 14:58:49.088698 23711 leader_election.cc:302] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72808cdfce23462ebd93e82096b4e944, 95d569be2ad447ab94ac2e16517591d9; no voters: 26b69f7bdc9f466cb34829df09732245
I20260811 14:58:49.088903 25129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 14:58:49.088902 23758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95d569be2ad447ab94ac2e16517591d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "72808cdfce23462ebd93e82096b4e944" is_pre_election: true
I20260811 14:58:49.089023 25129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26b69f7bdc9f466cb34829df09732245)
I20260811 14:58:49.089107 25129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:58:49.090157 25129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } }
I20260811 14:58:49.090425 23758 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95d569be2ad447ab94ac2e16517591d9 in current term 2: Already voted for candidate 72808cdfce23462ebd93e82096b4e944 in this term.
I20260811 14:58:49.090549 25129 leader_election.cc:288] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 election: Requested vote from peers 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185), 95d569be2ad447ab94ac2e16517591d9 (127.11.225.124:41433)
I20260811 14:58:49.090921 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.090660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32824)
0811 14:58:49.090815 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.090866 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 14:58:49.090890 24076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "72808cdfce23462ebd93e82096b4e944" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "95d569be2ad447ab94ac2e16517591d9"
I20260811 14:58:49.091012 24076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:58:49.091226 24038 leader_election.cc:302] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95d569be2ad447ab94ac2e16517591d9; no voters: 26b69f7bdc9f466cb34829df09732245, 72808cdfce23462ebd93e82096b4e944
I20260811 14:58:49.091733 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.091441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32828)
0811 14:58:49.091636 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.091675 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260811 14:58:49.091921 23712 leader_election.cc:334] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185): Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
I20260811 14:58:49.092164 24076 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72808cdfce23462ebd93e82096b4e944 in term 2.
I20260811 14:58:49.092278 25132 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 14:58:49.092432 23711 leader_election.cc:302] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72808cdfce23462ebd93e82096b4e944, 95d569be2ad447ab94ac2e16517591d9; no voters: 26b69f7bdc9f466cb34829df09732245
I20260811 14:58:49.092578 25129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:58:49.092804 25129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [term 2 LEADER]: Becoming Leader. State: Replica: 72808cdfce23462ebd93e82096b4e944, State: Running, Role: LEADER
I20260811 14:58:49.093062 25129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } }
I20260811 14:58:49.094406 25149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72808cdfce23462ebd93e82096b4e944. Latest consensus state: current_term: 2 leader_uuid: "72808cdfce23462ebd93e82096b4e944" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:49.094535 25149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:49.094832 25154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:49.097286 25154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:49.097694 25154 catalog_manager.cc:1259] Loaded cluster ID: 1dd8a1add5484ec6b30062d5c21fba96
I20260811 14:58:49.097764 25154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:49.098304 25154 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:49.098716 25154 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Loaded TSK: 0
I20260811 14:58:49.099395 25154 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:58:49.131485 23742 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:49.134927 23742 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:49.138088 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.137824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32850)
0811 14:58:49.137939 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.138001 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 14:58:49.138353 24076 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [term 2 FOLLOWER]: Refusing update from remote peer 72808cdfce23462ebd93e82096b4e944: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 14:58:49.138931 25149 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 14:58:49.139197 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.138898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.0.0.1:32852)
0811 14:58:49.139010 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.139121 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 14:58:49.139331 23712 consensus_peers.cc:487] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 -> Peer 26b69f7bdc9f466cb34829df09732245 (127.11.225.126:46185): Couldn't send request to peer 26b69f7bdc9f466cb34829df09732245. Status: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 14:58:49.140548 25132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72808cdfce23462ebd93e82096b4e944. Latest consensus state: current_term: 2 leader_uuid: "72808cdfce23462ebd93e82096b4e944" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:49.140694 25132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:49.141795 25149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "72808cdfce23462ebd93e82096b4e944" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:49.141937 25149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:49.142097 25156 mvcc.cc:205] Tried to move back new op lower bound from 7317341508144336896 to 7317341507967684608. Current Snapshot: MvccSnapshot[applied={T|T < 7317341508144336896}]
I20260811 14:58:49.142880 25132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "72808cdfce23462ebd93e82096b4e944" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "26b69f7bdc9f466cb34829df09732245" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46185 } } peers { permanent_uuid: "72808cdfce23462ebd93e82096b4e944" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 43253 } attrs { promote: false } } peers { permanent_uuid: "95d569be2ad447ab94ac2e16517591d9" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 41433 } attrs { promote: false } } }
I20260811 14:58:49.143009 25132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d569be2ad447ab94ac2e16517591d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 14:58:49.152060 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.148218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:38811 (local address 127.0.0.1:36224)
0811 14:58:49.148399 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.148412 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.148494 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.148859 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.148863 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.148886 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.149001 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.149007 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.150087 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.150092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.150869 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.150877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.151596 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.151600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.151725 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.151797 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.151851 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.151924 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":1}
I20260811 14:58:49.152519 25134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.147613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:43025 (local address 127.0.0.1:46730)
0811 14:58:49.147807 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.147824 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.147907 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.148287 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.148290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.148310 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.148416 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.148422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.149603 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.149606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.150781 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.150789 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.151666 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.151670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.152299 (+ 629us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.152320 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.152380 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.152430 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":495}
I20260811 14:58:49.152652 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.147741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46730 (local address 127.11.225.66:43025)
0811 14:58:49.148009 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.148016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.148034 (+ 18us) server_negotiation.cc:407] Connection header received
0811 14:58:49.148094 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.148097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.148158 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.148545 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.148670 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.149467 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.150928 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.151530 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.151811 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.151880 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.152424 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.152507 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":88,"threads_started":1}
I20260811 14:58:49.153108 25163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.148307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36224 (local address 127.11.225.67:38811)
0811 14:58:49.148574 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.148580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.148593 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:49.148641 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.148648 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.148685 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.149128 (+ 443us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.149279 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.149980 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.150990 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.151443 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.152815 (+ 1372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.152884 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.152915 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.152969 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":64,"threads_started":1}
I20260811 14:58:49.153141 24550 tablet_service.cc:1467] Processing CreateTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 (DEFAULT_TABLE table=test-table [id=d4f95b2ccf45472e98c05d01932f0249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:49.153275 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.148231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44005 (local address 127.0.0.1:52750)
0811 14:58:49.148850 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.148863 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.148942 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.149574 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.149577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.149596 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.149678 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.149684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.150710 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.150714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.151847 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.151856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.152859 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.152862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.152949 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.152971 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.153061 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.153125 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":339,"thread_start_us":102,"threads_started":1}
I20260811 14:58:49.153494 24550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906841a01bc46588cbb2a8d1a3635d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:49.153635 24845 tablet_service.cc:1467] Processing CreateTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 (DEFAULT_TABLE table=test-table [id=d4f95b2ccf45472e98c05d01932f0249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:49.153719 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.148411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.11.225.65:44005)
0811 14:58:49.149337 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.149342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.149355 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:49.149403 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.149405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.149447 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.149551 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.149796 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.150584 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.151983 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.152616 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.152723 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.152797 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.153085 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.153581 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":101,"threads_started":1}
I20260811 14:58:49.153895 24845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906841a01bc46588cbb2a8d1a3635d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:49.156261 25167 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Bootstrap starting.
I20260811 14:58:49.156781 25169 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Bootstrap starting.
I20260811 14:58:49.156806 24284 tablet_service.cc:1467] Processing CreateTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 (DEFAULT_TABLE table=test-table [id=d4f95b2ccf45472e98c05d01932f0249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:49.157078 24284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2906841a01bc46588cbb2a8d1a3635d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:49.157275 25167 tablet_bootstrap.cc:654] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:49.157981 25169 tablet_bootstrap.cc:654] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:49.158493 25167 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: No bootstrap required, opened a new log
I20260811 14:58:49.158607 25167 ts_tablet_manager.cc:1397] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:49.159067 25167 raft_consensus.cc:348] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.159181 25167 raft_consensus.cc:374] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:49.159220 25167 raft_consensus.cc:729] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b31d880db8f346ddb6768cc16a9adf9c, State: Initialized, Role: FOLLOWER
I20260811 14:58:49.159298 25169 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: No bootstrap required, opened a new log
I20260811 14:58:49.159396 25169 ts_tablet_manager.cc:1397] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 14:58:49.159366 25167 consensus_queue.cc:260] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.159971 25182 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674: Bootstrap starting.
I20260811 14:58:49.160420 25169 raft_consensus.cc:348] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.160529 25169 raft_consensus.cc:374] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:49.160574 25169 raft_consensus.cc:729] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea5cbdba68343e89c50485c174a3a88, State: Initialized, Role: FOLLOWER
I20260811 14:58:49.160712 25169 consensus_queue.cc:260] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.160873 25182 tablet_bootstrap.cc:654] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:49.161055 25169 ts_tablet_manager.cc:1428] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:49.161162 25167 ts_tablet_manager.cc:1428] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 14:58:49.161985 25182 tablet_bootstrap.cc:492] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674: No bootstrap required, opened a new log
I20260811 14:58:49.162086 25182 ts_tablet_manager.cc:1397] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:49.162231 24685 heartbeater.cc:503] Master 127.11.225.125:43253 was elected leader, sending a full tablet report...
I20260811 14:58:49.162488 25182 raft_consensus.cc:348] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.162601 25182 raft_consensus.cc:374] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:49.162636 25182 raft_consensus.cc:729] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096ccda90f7f4063b305639d18caf674, State: Initialized, Role: FOLLOWER
I20260811 14:58:49.162745 25182 consensus_queue.cc:260] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.162801 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.159990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:46345)
0811 14:58:49.162636 (+ 2646us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.162695 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2586,"thread_start_us":88,"threads_started":1}
I20260811 14:58:49.163082 25182 ts_tablet_manager.cc:1428] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:49.164050 25183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.163206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:50521)
0811 14:58:49.163906 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.163954 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":95,"threads_started":1}
I20260811 14:58:49.165206 24413 heartbeater.cc:503] Master 127.11.225.125:43253 was elected leader, sending a full tablet report...
I20260811 14:58:49.165593 24980 heartbeater.cc:503] Master 127.11.225.125:43253 was elected leader, sending a full tablet report...
I20260811 14:58:49.165558 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.163677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:58083)
0811 14:58:49.165409 (+ 1732us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.165462 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1667,"thread_start_us":86,"threads_started":1}
I20260811 14:58:49.166392 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.164811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:49031)
0811 14:58:49.165051 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.166277 (+ 1226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":113,"threads_started":1}
I20260811 14:58:49.166743 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.166322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:45523)
0811 14:58:49.166612 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.166660 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":92,"threads_started":1}
I20260811 14:58:49.167088 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.166778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:38493)
0811 14:58:49.166964 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.167016 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 14:58:49.347851 25184 raft_consensus.cc:482] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:49.348012 25184 raft_consensus.cc:504] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.349305 25184 leader_election.cc:288] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025), 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
I20260811 14:58:49.353788 25162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.349976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:32995 (local address 127.11.225.66:43025)
0811 14:58:49.350097 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.350101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.350112 (+ 11us) server_negotiation.cc:407] Connection header received
0811 14:58:49.350190 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.350193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.350244 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.350327 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.350710 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.351511 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.352769 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.353187 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.353347 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.353401 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.353589 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.353658 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 14:58:49.353817 25209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.349465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:43025 (local address 127.11.225.67:32995)
0811 14:58:49.349655 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.349670 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.349793 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.350372 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.350378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.350412 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.350564 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.350574 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.351668 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.351671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.352635 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.352645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.353340 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.353344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.353432 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.353455 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.353569 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.353645 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":98,"spinlock_wait_cycles":2688}
I20260811 14:58:49.354372 24585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906841a01bc46588cbb2a8d1a3635d7" candidate_uuid: "7ea5cbdba68343e89c50485c174a3a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b31d880db8f346ddb6768cc16a9adf9c" is_pre_election: true
I20260811 14:58:49.354528 24585 raft_consensus.cc:2454] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea5cbdba68343e89c50485c174a3a88 in term 0.
I20260811 14:58:49.354775 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.349575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44005 (local address 127.11.225.67:46483)
0811 14:58:49.349688 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.349705 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:49.349793 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:49.350483 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:49.350490 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:49.350512 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:49.350615 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.350619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.351637 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.351641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.353232 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:49.353249 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.354372 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.354375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:49.354476 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.354500 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 14:58:49.354584 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 14:58:49.354647 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":2,"spinlock_wait_cycles":10496}
I20260811 14:58:49.354905 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.350081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:46483 (local address 127.11.225.65:44005)
0811 14:58:49.350226 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.350230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.350243 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:49.350297 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.350302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.350348 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.350414 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:49.350767 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.351511 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.353409 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.354231 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.354382 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.354457 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.354617 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.354718 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 14:58:49.355151 24742 leader_election.cc:302] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ea5cbdba68343e89c50485c174a3a88, b31d880db8f346ddb6768cc16a9adf9c; no voters:
I20260811 14:58:49.355412 25184 raft_consensus.cc:2781] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:49.355508 25184 raft_consensus.cc:482] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:49.355573 25184 raft_consensus.cc:3037] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:49.355655 24318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906841a01bc46588cbb2a8d1a3635d7" candidate_uuid: "7ea5cbdba68343e89c50485c174a3a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096ccda90f7f4063b305639d18caf674" is_pre_election: true
I20260811 14:58:49.355901 24318 raft_consensus.cc:2454] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ea5cbdba68343e89c50485c174a3a88 in term 0.
I20260811 14:58:49.356853 25184 raft_consensus.cc:504] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.357197 25184 leader_election.cc:288] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [CANDIDATE]: Term 1 election: Requested vote from peers b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025), 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005)
I20260811 14:58:49.357498 24585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906841a01bc46588cbb2a8d1a3635d7" candidate_uuid: "7ea5cbdba68343e89c50485c174a3a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b31d880db8f346ddb6768cc16a9adf9c"
I20260811 14:58:49.357642 24585 raft_consensus.cc:3037] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:49.357599 24318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2906841a01bc46588cbb2a8d1a3635d7" candidate_uuid: "7ea5cbdba68343e89c50485c174a3a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096ccda90f7f4063b305639d18caf674"
I20260811 14:58:49.357746 24318 raft_consensus.cc:3037] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:49.358597 24585 raft_consensus.cc:2454] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea5cbdba68343e89c50485c174a3a88 in term 1.
I20260811 14:58:49.358872 24742 leader_election.cc:302] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ea5cbdba68343e89c50485c174a3a88, b31d880db8f346ddb6768cc16a9adf9c; no voters:
I20260811 14:58:49.359086 25184 raft_consensus.cc:2781] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:49.359334 25184 raft_consensus.cc:686] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 LEADER]: Becoming Leader. State: Replica: 7ea5cbdba68343e89c50485c174a3a88, State: Running, Role: LEADER
I20260811 14:58:49.359333 24318 raft_consensus.cc:2454] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ea5cbdba68343e89c50485c174a3a88 in term 1.
I20260811 14:58:49.360057 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.359812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:50589)
0811 14:58:49.359949 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.359999 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 14:58:49.359603 25184 consensus_queue.cc:237] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } }
I20260811 14:58:49.362728 23742 catalog_manager.cc:5495] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67). New cstate: current_term: 1 leader_uuid: "7ea5cbdba68343e89c50485c174a3a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ea5cbdba68343e89c50485c174a3a88" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 38811 } health_report { overall_health: HEALTHY } } }
I20260811 14:58:49.391438 25163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.388131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36236 (local address 127.11.225.67:38811)
0811 14:58:49.388256 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:49.388259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:49.388272 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:49.388345 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:49.388347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:49.388403 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:49.388493 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:49.388689 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.389171 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.390035 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:49.390262 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:49.390337 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:49.390601 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:49.391087 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:49.391189 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:49.391255 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 14:58:49.391329 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:49.393993 24585 raft_consensus.cc:1261] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Refusing update from remote peer 7ea5cbdba68343e89c50485c174a3a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:49.394317 24318 raft_consensus.cc:1261] T 2906841a01bc46588cbb2a8d1a3635d7 P 096ccda90f7f4063b305639d18caf674 [term 1 FOLLOWER]: Refusing update from remote peer 7ea5cbdba68343e89c50485c174a3a88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:49.394583 25210 consensus_queue.cc:1035] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b31d880db8f346ddb6768cc16a9adf9c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 43025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:49.394867 25184 consensus_queue.cc:1035] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096ccda90f7f4063b305639d18caf674" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:49.396461 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.396218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:39839)
0811 14:58:49.396319 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.396381 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:58:49.397401 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.397131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:34361)
0811 14:58:49.397259 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.397327 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 14:58:49.400341 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.400077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.66:45921)
0811 14:58:49.400222 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.400275 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 14:58:49.402577 25208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.402317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.65:52643)
0811 14:58:49.402428 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.402482 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 14:58:49.404035 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.399562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:40429)
0811 14:58:49.403907 (+ 4345us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.403965 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4252}
I20260811 14:58:49.404759 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.404509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46185 (local address 127.11.225.67:38361)
0811 14:58:49.404640 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.404694 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:46185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 14:58:49.405673 25218 mvcc.cc:205] Tried to move back new op lower bound from 7317341509193158656 to 7317341509061603328. Current Snapshot: MvccSnapshot[applied={T|T < 7317341509193158656}]
I20260811 14:58:49.412820 23742 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:49.412956 23742 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:49.417084 23742 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72808cdfce23462ebd93e82096b4e944: Sending DeleteTablet for 3 replicas of tablet 2906841a01bc46588cbb2a8d1a3635d7
I20260811 14:58:49.417726 24550 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:49 UTC) from {username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:46730
I20260811 14:58:49.418015 24845 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:49 UTC) from {username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:36224
I20260811 14:58:49.418067 24284 tablet_service.cc:1514] Processing DeleteTablet for tablet 2906841a01bc46588cbb2a8d1a3635d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:49 UTC) from {username='oryx', principal='oryx/127.11.225.125@KRBTEST.COM'} at 127.0.0.1:52750
I20260811 14:58:49.418440 25232 tablet_replica.cc:330] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: stopping tablet replica
I20260811 14:58:49.418581 25232 raft_consensus.cc:2229] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:49.418591 25228 tablet_replica.cc:330] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: stopping tablet replica
I20260811 14:58:49.418805 25228 raft_consensus.cc:2229] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:49.418910 25232 raft_consensus.cc:2258] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:49.418936 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 23992
I20260811 14:58:49.422664 25232 ts_tablet_manager.cc:1905] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:49.426427 25232 ts_tablet_manager.cc:1918] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:49.426532 25232 log.cc:1196] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/2906841a01bc46588cbb2a8d1a3635d7
I20260811 14:58:49.426892 25232 ts_tablet_manager.cc:1939] T 2906841a01bc46588cbb2a8d1a3635d7 P 7ea5cbdba68343e89c50485c174a3a88: Deleting consensus metadata
I20260811 14:58:49.429486 23710 catalog_manager.cc:4841] TS 7ea5cbdba68343e89c50485c174a3a88 (127.11.225.67:38811): tablet 2906841a01bc46588cbb2a8d1a3635d7 (table test-table [id=d4f95b2ccf45472e98c05d01932f0249]) successfully deleted
I20260811 14:58:49.418988 25228 raft_consensus.cc:2258] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:49.433598 25228 ts_tablet_manager.cc:1905] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:49.436240 25228 ts_tablet_manager.cc:1918] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:49.436383 25228 log.cc:1196] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/2906841a01bc46588cbb2a8d1a3635d7
I20260811 14:58:49.436712 25228 ts_tablet_manager.cc:1939] T 2906841a01bc46588cbb2a8d1a3635d7 P b31d880db8f346ddb6768cc16a9adf9c: Deleting consensus metadata
I20260811 14:58:49.437528 23712 catalog_manager.cc:4841] TS b31d880db8f346ddb6768cc16a9adf9c (127.11.225.66:43025): tablet 2906841a01bc46588cbb2a8d1a3635d7 (table test-table [id=d4f95b2ccf45472e98c05d01932f0249]) successfully deleted
I20260811 14:58:49.440958 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 24428
I20260811 14:58:49.441011 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:49.440704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44005 (local address 127.0.0.1:52752)
0811 14:58:49.440857 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:49.440919 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 14:58:49.447248 23707 catalog_manager.cc:4584] TS 096ccda90f7f4063b305639d18caf674 (127.11.225.65:44005): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2906841a01bc46588cbb2a8d1a3635d7: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44005: connect: Connection refused (error 111)
I20260811 14:58:49.456068 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 24697
I20260811 14:58:49.470018 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 23486
I20260811 14:58:49.481675 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 23669
2026-08-11T14:58:49Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5969 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:49 dist-test-slave-8hhm krb5kdc[25240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:49 dist-test-slave-8hhm krb5kdc[25240](info): set up 2 sockets
Aug 11 14:58:49 dist-test-slave-8hhm krb5kdc[25240](info): commencing operation
krb5kdc: starting...
W20260811 14:58:50.790536 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:50 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:50Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab.
Entry for principal oryx/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab.
I20260811 14:58:50.924345 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43611
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab
--principal=oryx/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:51.039888 25265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:51.040336 25265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:51.040453 25265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:51.046885 25265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:51.046944 25265 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 14:58:51.046986 25265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:51.047037 25265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:51.047075 25265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:51.047112 25265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:51.055797 25265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43611
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.126.keytab
--principal=oryx/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:51.057359 25265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:51.058926 25265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:51.069505 25277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.069614 25279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.069744 25276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:51.069936 25265 server_base.cc:1034] running on GCE node
I20260811 14:58:51.070622 25265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:51.071975 25265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:51.073191 25265 hybrid_clock.cc:648] HybridClock initialized: now 1786460331073164 us; error 42 us; skew 500 ppm
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:51.077437 25265 init.cc:377] Logged in from keytab as oryx/127.11.225.126@KRBTEST.COM (short username oryx)
I20260811 14:58:51.078675 25265 webserver.cc:460] Webserver started at http://127.11.225.126:38847/ using document root <none> and password file <none>
I20260811 14:58:51.079447 25265 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:51.079550 25265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:51.079831 25265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:51.082930 25265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "ce074d7798c54cab86a836a32cb7bb7d"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "4a2eb759de475455613b4472ab01cb35"
server_key_iv: "bdac229cc77e48a3ef8c49fbc2b9a5ad"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.083709 25265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "ce074d7798c54cab86a836a32cb7bb7d"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "4a2eb759de475455613b4472ab01cb35"
server_key_iv: "bdac229cc77e48a3ef8c49fbc2b9a5ad"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.088905 25265 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 14:58:51.092252 25294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.093559 25265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 14:58:51.093696 25265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "ce074d7798c54cab86a836a32cb7bb7d"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "4a2eb759de475455613b4472ab01cb35"
server_key_iv: "bdac229cc77e48a3ef8c49fbc2b9a5ad"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.093818 25265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:51.124485 25265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:51.127529 25265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:51.127751 25265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:51.135751 25265 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:43611
I20260811 14:58:51.135778 25418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:43611 every 8 connection(s)
I20260811 14:58:51.136698 25265 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:51.139509 25419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:51.141708 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 25265
I20260811 14:58:51.141827 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:51.142153 12165 external_mini_cluster.cc:1428] Setting key 60049d73f46d7e7f4b116e58812be11f
I20260811 14:58:51.146323 25419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Bootstrap starting.
I20260811 14:58:51.148532 25419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:51.149343 25419 log.cc:824] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Log is configured to *not* fsync() on all Append() calls
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:51.151496 25419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: No bootstrap required, opened a new log
I20260811 14:58:51.155009 25419 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } }
I20260811 14:58:51.155246 25419 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:51.155308 25419 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce074d7798c54cab86a836a32cb7bb7d, State: Initialized, Role: FOLLOWER
I20260811 14:58:51.155776 25419 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } }
I20260811 14:58:51.155929 25419 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:51.155997 25419 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:51.156121 25419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:51.156966 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.143612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.11.225.126:43611)
0811 14:58:51.144068 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.144082 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.144118 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:51.144768 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.144785 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.145089 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.145468 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.146288 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.147322 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.148205 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.148727 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.148892 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.151662 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.151667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.151680 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.151717 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.153947 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.154443 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.154447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.154451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.154558 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.154862 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.154864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.154865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.155252 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.155506 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.155793 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.156267 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":149,"threads_started":1}
I20260811 14:58:51.156942 25419 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } }
I20260811 14:58:51.157490 25419 leader_election.cc:302] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce074d7798c54cab86a836a32cb7bb7d; no voters:
I20260811 14:58:51.157843 25419 leader_election.cc:288] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:51.157914 25432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:51.158143 25432 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [term 1 LEADER]: Becoming Leader. State: Replica: ce074d7798c54cab86a836a32cb7bb7d, State: Running, Role: LEADER
I20260811 14:58:51.158434 25432 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } }
I20260811 14:58:51.159116 25419 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:51.160188 25434 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce074d7798c54cab86a836a32cb7bb7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } } }
I20260811 14:58:51.160320 25434 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:51.161434 25449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:51.161428 25435 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce074d7798c54cab86a836a32cb7bb7d. Latest consensus state: current_term: 1 leader_uuid: "ce074d7798c54cab86a836a32cb7bb7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce074d7798c54cab86a836a32cb7bb7d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43611 } } }
I20260811 14:58:51.161527 25435 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:51.164615 25449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:51.170889 25449 catalog_manager.cc:1347] Generated new cluster ID: 6c1c1d91f24b4e8d9a4bd379cf5fa749
I20260811 14:58:51.170964 25449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:51.190039 25449 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:51.190905 25449 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:51.195502 25449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Generated new TSK 0
I20260811 14:58:51.196112 25449 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
I20260811 14:58:51.232604 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43611
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:51.350678 25468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:51.350936 25468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:51.350979 25468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:51.354969 25468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:51.355020 25468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:51.355090 25468 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:51.355158 25468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:51.360499 25468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:51.361727 25468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:51.362739 25468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:51.372370 25489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.372403 25491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.372391 25482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:51.372538 25468 server_base.cc:1034] running on GCE node
I20260811 14:58:51.372921 25468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:51.373628 25468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:51.374795 25468 hybrid_clock.cc:648] HybridClock initialized: now 1786460331374779 us; error 26 us; skew 500 ppm
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:51.377626 25468 init.cc:377] Logged in from keytab as oryx/127.11.225.65@KRBTEST.COM (short username oryx)
I20260811 14:58:51.378450 25468 webserver.cc:460] Webserver started at http://127.11.225.65:33611/ using document root <none> and password file <none>
I20260811 14:58:51.379011 25468 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:51.379102 25468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:51.379340 25468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:51.381379 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "706cffbb1e8c4bd59b4a4f9782e1490e"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "2cc9edf79075df8f943f42ceac6e4995"
server_key_iv: "ab0ab266abb2b7b941bcc91b29305ac9"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.381953 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "706cffbb1e8c4bd59b4a4f9782e1490e"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "2cc9edf79075df8f943f42ceac6e4995"
server_key_iv: "ab0ab266abb2b7b941bcc91b29305ac9"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.385639 25468 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:51.387974 25506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.389276 25468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:51.389417 25468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "706cffbb1e8c4bd59b4a4f9782e1490e"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "2cc9edf79075df8f943f42ceac6e4995"
server_key_iv: "ab0ab266abb2b7b941bcc91b29305ac9"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.389523 25468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:51.399447 25468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:51.402370 25468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:51.402578 25468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:51.403980 25468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:51.404074 25468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.404165 25468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:51.404222 25468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:51.415170 25468 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:44123
I20260811 14:58:51.415241 25724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:44123 every 8 connection(s)
I20260811 14:58:51.416381 25468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:51.419301 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.404963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:46987 (local address 127.11.225.126:43611)
0811 14:58:51.405101 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.405105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.406172 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 14:58:51.407297 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.407304 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.407374 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.407463 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.409285 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.410164 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.412081 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.412318 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.412403 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.415602 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.415606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.415609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.415639 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.417265 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.417825 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.417828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.417829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.417908 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.418222 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.418224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.418225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.418402 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.418472 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.419067 (+ 595us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.419176 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:51.419661 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 25468
I20260811 14:58:51.419803 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:51.420070 25523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.405560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.65:46987)
0811 14:58:51.406024 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.406069 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.407031 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.407928 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.407938 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.408364 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.409064 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.409086 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.410339 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.410346 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.411932 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.411946 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.412500 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.412506 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.412734 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.413446 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.413474 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.415414 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.417398 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.417405 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.417421 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.417722 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.417989 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.417991 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.417992 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.418149 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.418491 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.418496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.418709 (+ 213us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.418851 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.419131 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":127,"threads_started":1}
I20260811 14:58:51.420097 12165 external_mini_cluster.cc:1428] Setting key 06e3c7ddba5ff5a5be1568e4864463bf
I20260811 14:58:51.421764 25730 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43611
I20260811 14:58:51.421914 25730 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:51.422505 25730 heartbeater.cc:511] Master 127.11.225.126:43611 requested a full tablet report, sending...
I20260811 14:58:51.424225 25330 ts_manager.cc:194] Registered new tserver with Master: 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123)
I20260811 14:58:51.425698 25330 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:46987
I20260811 14:58:51.431847 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.424094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.65:43759)
0811 14:58:51.424540 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.424551 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.424657 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.424878 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.424880 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.425070 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.425159 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.425164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.425922 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.425925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.426701 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.426711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.427376 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.427380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.427473 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.428010 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.428021 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.428340 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.430400 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.430402 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.430404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.430597 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.430900 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.430902 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.430903 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.430976 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.431432 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.431434 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.431509 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.431589 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.431690 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":119,"threads_started":1}
I20260811 14:58:51.431995 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.424147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:43759 (local address 127.11.225.126:43611)
0811 14:58:51.424268 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.424272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.424619 (+ 347us) server_negotiation.cc:407] Connection header received
0811 14:58:51.424730 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.424733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.424771 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.424862 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.425303 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.425813 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.426835 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.427236 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.427358 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.428484 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.428488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.428493 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.428522 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.430278 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.430706 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.430711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.430713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.430807 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.431065 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.431068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.431070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.431318 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.431436 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.431685 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.431819 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for oryx/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
I20260811 14:58:51.451913 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43611
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:51.566213 25744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:51.566486 25744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:51.566561 25744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:51.570755 25744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:51.570832 25744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:51.570896 25744 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:51.570973 25744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:51.576165 25744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:51.577253 25744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:51.578270 25744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:51.587937 25756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.587946 25761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.588109 25755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:51.588346 25744 server_base.cc:1034] running on GCE node
I20260811 14:58:51.588724 25744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:51.589406 25744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:51.590624 25744 hybrid_clock.cc:648] HybridClock initialized: now 1786460331590598 us; error 45 us; skew 500 ppm
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:51.593739 25744 init.cc:377] Logged in from keytab as oryx/127.11.225.66@KRBTEST.COM (short username oryx)
I20260811 14:58:51.594576 25744 webserver.cc:460] Webserver started at http://127.11.225.66:37053/ using document root <none> and password file <none>
I20260811 14:58:51.595120 25744 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:51.595211 25744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:51.595456 25744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:51.597676 25744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "7687ed51bbb44df294ca604d57ed2ed0"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "f90f030852b1e9633a0559d1c49d6b95"
server_key_iv: "a1c933f4a35dcd298a4e23dfebd2c254"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.598325 25744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "7687ed51bbb44df294ca604d57ed2ed0"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "f90f030852b1e9633a0559d1c49d6b95"
server_key_iv: "a1c933f4a35dcd298a4e23dfebd2c254"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.601991 25744 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:51.604525 25776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.605845 25744 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:51.605970 25744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "7687ed51bbb44df294ca604d57ed2ed0"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "f90f030852b1e9633a0559d1c49d6b95"
server_key_iv: "a1c933f4a35dcd298a4e23dfebd2c254"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.606101 25744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:51.616287 25744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:51.619148 25744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:51.619341 25744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:51.620714 25744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:51.620761 25744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.620798 25744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:51.620855 25744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:51.632261 25744 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:38255
I20260811 14:58:51.632321 26004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:38255 every 8 connection(s)
I20260811 14:58:51.633421 25744 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:51.634560 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.621642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:35007 (local address 127.11.225.126:43611)
0811 14:58:51.621778 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.621781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.622790 (+ 1009us) server_negotiation.cc:407] Connection header received
0811 14:58:51.624084 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.624088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.624162 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.624271 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.625655 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.626184 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.627484 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.627849 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.627957 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.630562 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.630566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.630568 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.630604 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.632186 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.632749 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.632752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.632754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.632855 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.633258 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.633262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.633264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.633531 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.633637 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.634236 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.634383 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:58:51.635288 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.622169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.66:35007)
0811 14:58:51.622643 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.622682 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.623777 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.624454 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.624464 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.624941 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.625509 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.625523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.626323 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.626327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.627347 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.627356 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.628018 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.628023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.628207 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.628800 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.628820 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.630390 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.632342 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.632349 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.632366 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.632641 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.632987 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.632989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.632991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.633128 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.633632 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.633638 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.633917 (+ 279us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.634141 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.634423 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":142,"threads_started":1}
I20260811 14:58:51.636598 26005 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43611
I20260811 14:58:51.636749 26005 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:51.637348 26005 heartbeater.cc:511] Master 127.11.225.126:43611 requested a full tablet report, sending...
I20260811 14:58:51.638377 25328 ts_manager.cc:194] Registered new tserver with Master: 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255)
I20260811 14:58:51.638937 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 25744
I20260811 14:58:51.639078 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:51.639089 25328 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:35007
I20260811 14:58:51.639402 12165 external_mini_cluster.cc:1428] Setting key d3252922789bc349102f73fbeeb741bf
I20260811 14:58:51.647176 26015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.638681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.66:39117)
0811 14:58:51.639951 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.639965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.640074 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.640309 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.640311 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.640496 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.640629 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.640639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.641702 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.641705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.642255 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.642263 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.642711 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.642715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.642804 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.643262 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.643273 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.643565 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.645510 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.645512 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.645514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.645716 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.646018 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.646020 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.646021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.646094 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.646650 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.646656 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.646743 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.646856 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.646985 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"thread_start_us":95,"threads_started":1}
I20260811 14:58:51.647194 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.638752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:39117 (local address 127.11.225.126:43611)
0811 14:58:51.639410 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.639415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.640039 (+ 624us) server_negotiation.cc:407] Connection header received
0811 14:58:51.640162 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.640165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.640210 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.640292 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.640954 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.641574 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.642377 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.642602 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.642705 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.643712 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.643716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.643718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.643755 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.645402 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.645814 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.645820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.645836 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.645927 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.646188 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.646194 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.646198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.646515 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.646645 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.646920 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.647026 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591}
WARNING: no policy specified for oryx/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
I20260811 14:58:51.669958 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43611
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:51.783648 26021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:51.783917 26021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:51.783993 26021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:51.788340 26021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:51.788439 26021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:51.788513 26021 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 14:58:51.788592 26021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:51.793973 26021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.225.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:51.795034 26021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:51.796049 26021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:51.805727 26032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:51.805853 26041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:51.805867 26021 server_base.cc:1034] running on GCE node
W20260811 14:58:51.805756 26034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:51.806313 26021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:51.806867 26021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:51.808061 26021 hybrid_clock.cc:648] HybridClock initialized: now 1786460331808030 us; error 42 us; skew 500 ppm
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:51.810912 26021 init.cc:377] Logged in from keytab as oryx/127.11.225.67@KRBTEST.COM (short username oryx)
I20260811 14:58:51.811805 26021 webserver.cc:460] Webserver started at http://127.11.225.67:42357/ using document root <none> and password file <none>
I20260811 14:58:51.812352 26021 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:51.812414 26021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:51.812656 26021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:51.814738 26021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "d7253d49593df9b36c38a0f2eaae9ff3"
server_key_iv: "727ffedeadf213cc3b482a1b8377cb6e"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.815301 26021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "d7253d49593df9b36c38a0f2eaae9ff3"
server_key_iv: "727ffedeadf213cc3b482a1b8377cb6e"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.819084 26021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:58:51.821735 26051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.823078 26021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:51.823211 26021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
format_stamp: "Formatted at 2026-08-11 14:58:51 on dist-test-slave-8hhm"
server_key: "d7253d49593df9b36c38a0f2eaae9ff3"
server_key_iv: "727ffedeadf213cc3b482a1b8377cb6e"
server_key_version: "encryptionkey@0"
I20260811 14:58:51.823315 26021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:51.862020 26021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:51.865202 26021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:51.865458 26021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:51.867044 26021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:51.867102 26021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:51.867169 26021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:51.867199 26021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:51.878628 26021 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:35625
I20260811 14:58:51.878698 26268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:35625 every 8 connection(s)
I20260811 14:58:51.879561 26021 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:51.881834 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.868016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:48843 (local address 127.11.225.126:43611)
0811 14:58:51.868150 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.868154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.869263 (+ 1109us) server_negotiation.cc:407] Connection header received
0811 14:58:51.870400 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.870404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.870476 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.870586 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.872071 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.872976 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.874210 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.874619 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.874754 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.877719 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.877722 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.877724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.877749 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.879669 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.880313 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.880316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.880318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.880413 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.880809 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.880812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.880814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.881006 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.881087 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.881617 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.881715 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:58:51.882624 26065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.868548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.67:48843)
0811 14:58:51.869083 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.869126 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.870128 (+ 1002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.870852 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.870858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.871254 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.871878 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.871900 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.873136 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.873139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.874069 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.874079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.874801 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.874805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.875034 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.875808 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.875824 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.877562 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.879803 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.879808 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.879821 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.880202 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.880504 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.880507 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.880509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.880701 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.881107 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.881112 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.881399 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.881550 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.881789 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":155,"threads_started":1}
I20260811 14:58:51.883932 26269 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43611
I20260811 14:58:51.884099 26269 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:51.884636 26269 heartbeater.cc:511] Master 127.11.225.126:43611 requested a full tablet report, sending...
I20260811 14:58:51.885656 25330 ts_manager.cc:194] Registered new tserver with Master: 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:51.886315 25330 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:48843
I20260811 14:58:51.887180 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 26021
I20260811 14:58:51.887323 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:51.887693 12165 external_mini_cluster.cc:1428] Setting key fd0f17637317d39946128ad8c084b5d9
I20260811 14:58:51.889755 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:58:51.893944 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.886173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:44423 (local address 127.11.225.126:43611)
0811 14:58:51.886300 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.886306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.886588 (+ 282us) server_negotiation.cc:407] Connection header received
0811 14:58:51.886702 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.886705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.886744 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.886828 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.887377 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.888088 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.889188 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.889534 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.889643 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.890777 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.890779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.890781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.890803 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.892188 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.892644 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.892649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.892652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.892775 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.893147 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.893149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.893150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.893370 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.893449 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.893750 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.893840 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 14:58:51.894120 26284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.886092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.11.225.67:44423)
0811 14:58:51.886506 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.886518 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.886625 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.886844 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.886847 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.887071 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:51.887231 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.887241 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.888205 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.888210 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.889072 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.889081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.889640 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.889642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.889752 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.890184 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:51.890198 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:51.890636 (+ 438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:51.892319 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.892325 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.892329 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.892545 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.892930 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:51.892934 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:51.892938 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:51.893049 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:51.893466 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:51.893470 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:51.893575 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.893705 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.893856 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":4,"thread_start_us":108,"threads_started":1}
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:58:51.915642 25429 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:51.909575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.11.225.126:43611)
0811 14:58:51.909706 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.909710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.909722 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:51.909758 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.909761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.909794 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.909886 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.910693 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.911188 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.912048 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.912258 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.912361 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.915534 (+ 3173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51854: BlockingRecv error: recv got EOF from 127.0.0.1:51854 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 14:58:51 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:51.925030 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.917065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51860 (local address 127.11.225.126:43611)
0811 14:58:51.917180 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.917184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.917338 (+ 154us) server_negotiation.cc:407] Connection header received
0811 14:58:51.917413 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.917415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.917450 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.917520 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:51.918087 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.918551 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.919282 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.919476 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.919552 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.921829 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:51.921832 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:51.921834 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:51.921856 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:51.923410 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.923827 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.923830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.923831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.923921 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:51.924219 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:51.924221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:51.924222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:51.924381 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:51.924481 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.924709 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.924798 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 14:58:51.927984 25330 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:51.931187 25330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:51.946091 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.940741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34710 (local address 127.11.225.65:44123)
0811 14:58:51.941117 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.941125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.941151 (+ 26us) server_negotiation.cc:407] Connection header received
0811 14:58:51.941317 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.941325 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.941529 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.942107 (+ 578us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:51.942242 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.943292 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.944697 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.945295 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.945429 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.945582 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.945831 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.945927 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260811 14:58:51.946118 26314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.939818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.0.0.1:34710)
0811 14:58:51.940649 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.940665 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.940765 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.941780 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.941783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.941803 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:51.941929 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.941937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.943422 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.943425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.944575 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.944583 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.945454 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.945459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.945587 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.945653 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.945792 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.945916 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":131,"threads_started":1}
I20260811 14:58:51.946331 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.939785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35625 (local address 127.0.0.1:56336)
0811 14:58:51.940509 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.940573 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.940710 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.941583 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.941589 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.941612 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:51.941761 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.941771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.943096 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.943102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.944442 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.944454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.945866 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.945870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.945973 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.945999 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.946095 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.946190 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":1,"thread_start_us":67,"threads_started":1}
I20260811 14:58:51.946734 26316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.939932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.11.225.67:35625)
0811 14:58:51.940297 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.940310 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.940862 (+ 552us) server_negotiation.cc:407] Connection header received
0811 14:58:51.940950 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.940955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.941198 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.941388 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:51.941903 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.942961 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.944584 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.945497 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.945603 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.945803 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.946484 (+ 681us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.946600 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":150,"threads_started":1}
I20260811 14:58:51.947075 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.941157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38254 (local address 127.11.225.66:38255)
0811 14:58:51.941624 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:51.941635 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:51.941929 (+ 294us) server_negotiation.cc:407] Connection header received
0811 14:58:51.942022 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:51.942030 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:51.942220 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:51.942367 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:51.942772 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.943852 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.945323 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.946202 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.946317 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.946452 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:51.946795 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 14:58:51.946905 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":148,"threads_started":1}
I20260811 14:58:51.947580 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:51.940536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38255 (local address 127.0.0.1:38254)
0811 14:58:51.941713 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:51.941730 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:51.941822 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:51.942524 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:51.942527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:51.942546 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:51.942635 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.942641 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.943993 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.943996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.945173 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:51.945186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:51.946541 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:51.946544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:51.946632 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:51.946655 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:58:51.946737 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 14:58:51.946805 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"mutex_wait_us":1,"spinlock_wait_cycles":1280,"thread_start_us":81,"threads_started":1}
I20260811 14:58:51.949484 25610 tablet_service.cc:1467] Processing CreateTablet for tablet ab20b325344e46e0820a87e90ca4cb04 (DEFAULT_TABLE table=test-table [id=09ba9808a3804560b15134fe5f6e0858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:51.949539 26145 tablet_service.cc:1467] Processing CreateTablet for tablet ab20b325344e46e0820a87e90ca4cb04 (DEFAULT_TABLE table=test-table [id=09ba9808a3804560b15134fe5f6e0858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:51.950546 25610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab20b325344e46e0820a87e90ca4cb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:51.950213 25881 tablet_service.cc:1467] Processing CreateTablet for tablet ab20b325344e46e0820a87e90ca4cb04 (DEFAULT_TABLE table=test-table [id=09ba9808a3804560b15134fe5f6e0858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:51.950628 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab20b325344e46e0820a87e90ca4cb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:51.951164 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab20b325344e46e0820a87e90ca4cb04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:51.956449 26327 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Bootstrap starting.
I20260811 14:58:51.958631 26329 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Bootstrap starting.
I20260811 14:58:51.959252 26330 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Bootstrap starting.
I20260811 14:58:51.960224 26327 tablet_bootstrap.cc:654] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:51.961127 26327 log.cc:824] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:51.961514 26330 tablet_bootstrap.cc:654] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:51.962682 26330 log.cc:824] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:51.963145 26329 tablet_bootstrap.cc:654] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:51.963591 26327 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: No bootstrap required, opened a new log
I20260811 14:58:51.963785 26327 ts_tablet_manager.cc:1397] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260811 14:58:51.963928 26329 log.cc:824] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:51.964638 26330 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: No bootstrap required, opened a new log
I20260811 14:58:51.964834 26330 ts_tablet_manager.cc:1397] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 14:58:51.966017 26329 tablet_bootstrap.cc:492] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: No bootstrap required, opened a new log
I20260811 14:58:51.966204 26329 ts_tablet_manager.cc:1397] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260811 14:58:51.967736 26327 raft_consensus.cc:348] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.967998 26327 raft_consensus.cc:374] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:51.968053 26327 raft_consensus.cc:729] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Initialized, Role: FOLLOWER
I20260811 14:58:51.968499 26327 consensus_queue.cc:260] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.968791 26330 raft_consensus.cc:348] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.969053 26330 raft_consensus.cc:374] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:51.969113 26330 raft_consensus.cc:729] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Initialized, Role: FOLLOWER
I20260811 14:58:51.969110 25730 heartbeater.cc:503] Master 127.11.225.126:43611 was elected leader, sending a full tablet report...
I20260811 14:58:51.969599 26330 consensus_queue.cc:260] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.970064 26329 raft_consensus.cc:348] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.970288 26269 heartbeater.cc:503] Master 127.11.225.126:43611 was elected leader, sending a full tablet report...
I20260811 14:58:51.970310 26329 raft_consensus.cc:374] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:51.970358 26329 raft_consensus.cc:729] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Initialized, Role: FOLLOWER
I20260811 14:58:51.970538 26327 ts_tablet_manager.cc:1428] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260811 14:58:51.970767 26329 consensus_queue.cc:260] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:51.971380 26005 heartbeater.cc:503] Master 127.11.225.126:43611 was elected leader, sending a full tablet report...
I20260811 14:58:51.971765 26329 ts_tablet_manager.cc:1428] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:58:51.972555 26330 ts_tablet_manager.cc:1428] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 14:58:52.001804 26342 raft_consensus.cc:482] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:52.002022 26342 raft_consensus.cc:504] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:52.003067 26342 leader_election.cc:288] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123), 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255)
I20260811 14:58:52.006984 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.003445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:51375 (local address 127.11.225.66:38255)
0811 14:58:52.003560 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.003565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.003582 (+ 17us) server_negotiation.cc:407] Connection header received
0811 14:58:52.003703 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.003705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.003743 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.003833 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.004161 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.004681 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.006017 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.006403 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.006550 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.006604 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.006792 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.006857 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:58:52.006996 26065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.003361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38255 (local address 127.11.225.67:51375)
0811 14:58:52.003457 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.003473 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.003594 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.003845 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.003848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.003866 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.004044 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.004051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.004794 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.004799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.005882 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.005892 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.006550 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.006553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.006658 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.006680 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.006774 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.006839 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 14:58:52.007603 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab20b325344e46e0820a87e90ca4cb04" candidate_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0" is_pre_election: true
I20260811 14:58:52.007736 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.003445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:53381 (local address 127.11.225.65:44123)
0811 14:58:52.003560 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.003565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.003971 (+ 406us) server_negotiation.cc:407] Connection header received
0811 14:58:52.004121 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.004129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.004167 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.004249 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.004529 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.005175 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.006696 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.007201 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.007313 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.007370 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.007568 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.007625 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 14:58:52.007761 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.003361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.11.225.67:53381)
0811 14:58:52.003854 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.003865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.003999 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.004260 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.004263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.004278 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.004412 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.004417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.005316 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.005320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.006568 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.006578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.007343 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.007349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.007443 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.007466 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.007543 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.007608 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"mutex_wait_us":95,"thread_start_us":154,"threads_started":1}
I20260811 14:58:52.007897 25921 raft_consensus.cc:2454] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d415a03fbec43acb1f6ccd5cf6a211b in term 0.
I20260811 14:58:52.008412 26059 leader_election.cc:302] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.008514 25655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab20b325344e46e0820a87e90ca4cb04" candidate_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" is_pre_election: true
I20260811 14:58:52.008756 25655 raft_consensus.cc:2454] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d415a03fbec43acb1f6ccd5cf6a211b in term 0.
I20260811 14:58:52.008981 26342 raft_consensus.cc:2781] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:52.009094 26342 raft_consensus.cc:482] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:52.009156 26342 raft_consensus.cc:3037] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.010389 26342 raft_consensus.cc:504] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:52.010763 26342 leader_election.cc:288] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [CANDIDATE]: Term 1 election: Requested vote from peers 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123), 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255)
I20260811 14:58:52.011076 25655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab20b325344e46e0820a87e90ca4cb04" candidate_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e"
I20260811 14:58:52.011166 25655 raft_consensus.cc:3037] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.012172 25655 raft_consensus.cc:2454] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d415a03fbec43acb1f6ccd5cf6a211b in term 1.
I20260811 14:58:52.012422 25921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab20b325344e46e0820a87e90ca4cb04" candidate_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0"
I20260811 14:58:52.012470 26057 leader_election.cc:302] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 706cffbb1e8c4bd59b4a4f9782e1490e; no voters:
I20260811 14:58:52.012538 25921 raft_consensus.cc:3037] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.012694 26342 raft_consensus.cc:2781] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:52.012923 26342 raft_consensus.cc:686] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 LEADER]: Becoming Leader. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Running, Role: LEADER
I20260811 14:58:52.013294 26342 consensus_queue.cc:237] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } }
I20260811 14:58:52.013859 25921 raft_consensus.cc:2454] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d415a03fbec43acb1f6ccd5cf6a211b in term 1.
I20260811 14:58:52.016692 25328 catalog_manager.cc:5495] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67). New cstate: current_term: 1 leader_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:52.028965 26316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.025354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56352 (local address 127.11.225.67:35625)
0811 14:58:52.025475 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.025481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.025528 (+ 47us) server_negotiation.cc:407] Connection header received
0811 14:58:52.025722 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.025731 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.025781 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.025887 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.026132 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.026708 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.027605 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.027824 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.027930 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.028198 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.028584 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.028723 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.028782 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.028832 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 14:58:52.034336 25655 raft_consensus.cc:1261] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Refusing update from remote peer 6d415a03fbec43acb1f6ccd5cf6a211b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.034786 25921 raft_consensus.cc:1261] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Refusing update from remote peer 6d415a03fbec43acb1f6ccd5cf6a211b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.035027 26345 consensus_queue.cc:1035] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [LEADER]: Connected to new peer: Peer: permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.035454 26342 consensus_queue.cc:1035] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.042330 26349 mvcc.cc:205] Tried to move back new op lower bound from 7317341520006041600 to 7317341519929659392. Current Snapshot: MvccSnapshot[applied={T|T < 7317341520006041600}]
I20260811 14:58:52.050766 25330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.050938 25330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.053367 25330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Sending DeleteTablet for 3 replicas of tablet ab20b325344e46e0820a87e90ca4cb04
I20260811 14:58:52.054219 25610 tablet_service.cc:1514] Processing DeleteTablet for tablet ab20b325344e46e0820a87e90ca4cb04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:34710
I20260811 14:58:52.054217 25881 tablet_service.cc:1514] Processing DeleteTablet for tablet ab20b325344e46e0820a87e90ca4cb04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:38254
I20260811 14:58:52.054687 25328 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 14:58:52.054926 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet ab20b325344e46e0820a87e90ca4cb04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:56336
W20260811 14:58:52.055096 25328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:52.055238 26367 tablet_replica.cc:330] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: stopping tablet replica
I20260811 14:58:52.055572 26367 raft_consensus.cc:2229] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.055938 26367 raft_consensus.cc:2258] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.055992 26368 tablet_replica.cc:330] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: stopping tablet replica
I20260811 14:58:52.056288 26368 raft_consensus.cc:2229] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.056567 26368 raft_consensus.cc:2258] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.058105 26367 ts_tablet_manager.cc:1905] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.059784 26368 ts_tablet_manager.cc:1905] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.060950 25610 tablet_service.cc:1467] Processing CreateTablet for tablet db869f79e0a448a085644d8a84401f58 (DEFAULT_TABLE table=test-table [id=a069bfd7afae405b8850a9271e2a1f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.061291 25610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db869f79e0a448a085644d8a84401f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.061491 25881 tablet_service.cc:1467] Processing CreateTablet for tablet db869f79e0a448a085644d8a84401f58 (DEFAULT_TABLE table=test-table [id=a069bfd7afae405b8850a9271e2a1f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.061777 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db869f79e0a448a085644d8a84401f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.063460 26368 ts_tablet_manager.cc:1918] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.063560 26368 log.cc:1196] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/ab20b325344e46e0820a87e90ca4cb04
I20260811 14:58:52.063861 26368 ts_tablet_manager.cc:1939] T ab20b325344e46e0820a87e90ca4cb04 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting consensus metadata
I20260811 14:58:52.063926 26327 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Bootstrap starting.
I20260811 14:58:52.064503 26145 tablet_service.cc:1467] Processing CreateTablet for tablet db869f79e0a448a085644d8a84401f58 (DEFAULT_TABLE table=test-table [id=a069bfd7afae405b8850a9271e2a1f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.064772 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db869f79e0a448a085644d8a84401f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.064899 26327 tablet_bootstrap.cc:654] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.065719 25303 catalog_manager.cc:4841] TS 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123): tablet ab20b325344e46e0820a87e90ca4cb04 (table test-table [id=09ba9808a3804560b15134fe5f6e0858]) successfully deleted
I20260811 14:58:52.066576 26327 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: No bootstrap required, opened a new log
I20260811 14:58:52.066643 26327 ts_tablet_manager.cc:1397] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:52.067055 26327 raft_consensus.cc:348] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.067157 26327 raft_consensus.cc:374] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.067165 26330 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Bootstrap starting.
I20260811 14:58:52.067188 26327 raft_consensus.cc:729] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.067301 26327 consensus_queue.cc:260] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.067451 26329 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Bootstrap starting.
I20260811 14:58:52.067562 26327 ts_tablet_manager.cc:1428] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.068149 26330 tablet_bootstrap.cc:654] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.068475 26329 tablet_bootstrap.cc:654] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.070144 26367 ts_tablet_manager.cc:1918] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.070235 26367 log.cc:1196] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/ab20b325344e46e0820a87e90ca4cb04
I20260811 14:58:52.070559 26367 ts_tablet_manager.cc:1939] T ab20b325344e46e0820a87e90ca4cb04 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting consensus metadata
I20260811 14:58:52.070775 26330 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: No bootstrap required, opened a new log
I20260811 14:58:52.070860 26330 ts_tablet_manager.cc:1397] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 14:58:52.071381 26330 raft_consensus.cc:348] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.071519 26330 raft_consensus.cc:374] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.071563 26330 raft_consensus.cc:729] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.071687 26330 consensus_queue.cc:260] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.071887 26370 tablet_replica.cc:330] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: stopping tablet replica
I20260811 14:58:52.072018 25306 catalog_manager.cc:4841] TS 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255): tablet ab20b325344e46e0820a87e90ca4cb04 (table test-table [id=09ba9808a3804560b15134fe5f6e0858]) successfully deleted
I20260811 14:58:52.072180 26370 raft_consensus.cc:2229] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:52.072501 26330 ts_tablet_manager.cc:1428] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:52.072556 26370 raft_consensus.cc:2258] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.073834 26370 ts_tablet_manager.cc:1905] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.073906 26329 tablet_bootstrap.cc:492] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: No bootstrap required, opened a new log
I20260811 14:58:52.073984 26329 ts_tablet_manager.cc:1397] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 14:58:52.074440 26329 raft_consensus.cc:348] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.074546 26329 raft_consensus.cc:374] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.074592 26329 raft_consensus.cc:729] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.074731 26329 consensus_queue.cc:260] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.075019 26329 ts_tablet_manager.cc:1428] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.076181 26338 raft_consensus.cc:482] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:52.076310 26370 ts_tablet_manager.cc:1918] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.076280 26338 raft_consensus.cc:504] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.076390 26370 log.cc:1196] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/ab20b325344e46e0820a87e90ca4cb04
I20260811 14:58:52.076692 26370 ts_tablet_manager.cc:1939] T ab20b325344e46e0820a87e90ca4cb04 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting consensus metadata
I20260811 14:58:52.077533 26338 leader_election.cc:288] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.077760 25306 catalog_manager.cc:4841] TS 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625): tablet ab20b325344e46e0820a87e90ca4cb04 (table test-table [id=09ba9808a3804560b15134fe5f6e0858]) successfully deleted
I20260811 14:58:52.082443 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.077872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:38255 (local address 127.11.225.65:37587)
0811 14:58:52.078477 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.078492 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.078586 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.078865 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.078867 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.078885 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.079006 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.079013 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.079876 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.079879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.081068 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.081078 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.081985 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.081991 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.082103 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.082129 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.082205 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.082273 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":67,"threads_started":1}
I20260811 14:58:52.082594 26316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.078292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53611 (local address 127.11.225.67:35625)
0811 14:58:52.078405 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.078411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.078807 (+ 396us) server_negotiation.cc:407] Connection header received
0811 14:58:52.078989 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.078992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.079032 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.079113 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.079456 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.080176 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.081512 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.081909 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.082026 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.082080 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.082367 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.082439 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:58:52.082770 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.078540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:37587 (local address 127.11.225.66:38255)
0811 14:58:52.078645 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.078649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.078663 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:52.078708 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.078711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.078763 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.078845 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.079144 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.079742 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.081204 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.081836 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.081955 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.082005 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.082587 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.082659 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:58:52.083325 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db869f79e0a448a085644d8a84401f58" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0" is_pre_election: true
I20260811 14:58:52.083469 25918 raft_consensus.cc:2454] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.083858 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.078221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35625 (local address 127.11.225.65:53611)
0811 14:58:52.078727 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.078741 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.078867 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.079213 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.079215 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.079231 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.079339 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.079345 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.080294 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.080297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.081394 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.081402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.082134 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.082138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.082237 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.082256 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.083638 (+ 1382us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.083729 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":96,"threads_started":1}
I20260811 14:58:52.083837 25512 leader_election.cc:302] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706cffbb1e8c4bd59b4a4f9782e1490e, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.084092 26338 raft_consensus.cc:2781] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:52.084156 26338 raft_consensus.cc:482] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:52.084203 26338 raft_consensus.cc:3037] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.084503 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db869f79e0a448a085644d8a84401f58" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" is_pre_election: true
I20260811 14:58:52.084702 26188 raft_consensus.cc:2454] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.085472 26338 raft_consensus.cc:504] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.085810 26338 leader_election.cc:288] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Requested vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.086167 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db869f79e0a448a085644d8a84401f58" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0"
I20260811 14:58:52.086167 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db869f79e0a448a085644d8a84401f58" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
I20260811 14:58:52.086270 26188 raft_consensus.cc:3037] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.086270 25918 raft_consensus.cc:3037] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.087322 26188 raft_consensus.cc:2454] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.087322 25918 raft_consensus.cc:2454] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.087649 25512 leader_election.cc:302] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 706cffbb1e8c4bd59b4a4f9782e1490e; no voters:
I20260811 14:58:52.087895 26338 raft_consensus.cc:2781] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:52.088104 26338 raft_consensus.cc:686] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 LEADER]: Becoming Leader. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Running, Role: LEADER
I20260811 14:58:52.088321 26338 consensus_queue.cc:237] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.090438 25328 catalog_manager.cc:5495] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e reported cstate change: term changed from 0 to 1, leader changed from <none> to 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65). New cstate: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } health_report { overall_health: UNKNOWN } } }
W20260811 14:58:52.130895 26271 tablet.cc:2369] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 14:58:52 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460331, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.126@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
W20260811 14:58:52.134532 26010 tablet.cc:2369] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:52.136813 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.127056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43611 (local address 127.0.0.1:51866)
0811 14:58:52.127405 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.127418 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.127544 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.127934 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.127936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.128323 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:52.128414 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.128420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.129478 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.129480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.130070 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.130079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.130732 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.130736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.130822 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.131501 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:52.131513 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:52.133127 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:52.135099 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:52.135107 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:52.135112 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:52.135353 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:52.135657 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:52.135660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:52.135662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:52.135755 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:52.136190 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:52.136198 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:52.136314 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.136428 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.136651 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
I20260811 14:58:52.136940 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.127105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51866 (local address 127.11.225.126:43611)
0811 14:58:52.127254 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.127259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.127498 (+ 239us) server_negotiation.cc:407] Connection header received
0811 14:58:52.127653 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.127656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.127709 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.127798 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:52.128540 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.129368 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.130184 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.130536 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.130638 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.133290 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:52.133294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:52.133297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:52.133322 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:52.134975 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:52.135484 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:52.135487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:52.135489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:52.135575 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:52.135857 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:52.135860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:52.135862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:52.136074 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:52.136171 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.136536 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.136740 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":61}
I20260811 14:58:52.145534 25328 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:51866:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 14:58:52.146322 25328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:52.151422 25610 tablet_service.cc:1467] Processing CreateTablet for tablet f050b0e77a1c4b7db5ea2c4089b2440b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcbd9a3af02241f9ac7242bc67ba4f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:52.151669 26145 tablet_service.cc:1467] Processing CreateTablet for tablet f050b0e77a1c4b7db5ea2c4089b2440b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcbd9a3af02241f9ac7242bc67ba4f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:52.151826 25610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f050b0e77a1c4b7db5ea2c4089b2440b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.152048 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f050b0e77a1c4b7db5ea2c4089b2440b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.154345 26327 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: Bootstrap starting.
I20260811 14:58:52.154769 25881 tablet_service.cc:1467] Processing CreateTablet for tablet f050b0e77a1c4b7db5ea2c4089b2440b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcbd9a3af02241f9ac7242bc67ba4f40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 14:58:52.155153 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f050b0e77a1c4b7db5ea2c4089b2440b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.155345 26327 tablet_bootstrap.cc:654] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.155455 26330 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: Bootstrap starting.
I20260811 14:58:52.156239 26330 tablet_bootstrap.cc:654] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.156994 26327 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: No bootstrap required, opened a new log
I20260811 14:58:52.157076 26327 ts_tablet_manager.cc:1397] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:52.157639 26327 raft_consensus.cc:348] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.157756 26327 raft_consensus.cc:374] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.157788 26327 raft_consensus.cc:729] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.157907 26327 consensus_queue.cc:260] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.158162 26327 ts_tablet_manager.cc:1428] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.158310 26329 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: Bootstrap starting.
I20260811 14:58:52.158345 26338 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.158457 26338 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.158484 26330 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: No bootstrap required, opened a new log
I20260811 14:58:52.158576 26330 ts_tablet_manager.cc:1397] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 14:58:52.159020 26330 raft_consensus.cc:348] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.159147 26330 raft_consensus.cc:374] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.159185 26330 raft_consensus.cc:729] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.159276 26329 tablet_bootstrap.cc:654] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.159307 26330 consensus_queue.cc:260] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.159578 26330 ts_tablet_manager.cc:1428] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.160113 26363 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.160247 26363 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.160521 26329 tablet_bootstrap.cc:492] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: No bootstrap required, opened a new log
I20260811 14:58:52.160617 26329 ts_tablet_manager.cc:1397] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:52.161020 26329 raft_consensus.cc:348] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.161139 26329 raft_consensus.cc:374] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.161172 26329 raft_consensus.cc:729] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.161340 26329 consensus_queue.cc:260] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.161631 26329 ts_tablet_manager.cc:1428] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.161572 26343 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.161695 26343 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 14:58:52.167785 25734 tablet.cc:2369] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:58:52.261795 26338 raft_consensus.cc:482] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:52.261940 26338 raft_consensus.cc:504] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.262545 26338 leader_election.cc:288] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.263176 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f050b0e77a1c4b7db5ea2c4089b2440b" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0" is_pre_election: true
I20260811 14:58:52.263176 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f050b0e77a1c4b7db5ea2c4089b2440b" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" is_pre_election: true
I20260811 14:58:52.263342 26188 raft_consensus.cc:2454] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.263342 25918 raft_consensus.cc:2454] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.263651 25512 leader_election.cc:302] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706cffbb1e8c4bd59b4a4f9782e1490e, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.263859 26338 raft_consensus.cc:2781] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:52.263954 26338 raft_consensus.cc:482] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:52.264010 26338 raft_consensus.cc:3037] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.265043 26338 raft_consensus.cc:504] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.265400 26338 leader_election.cc:288] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Requested vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.265817 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f050b0e77a1c4b7db5ea2c4089b2440b" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0"
I20260811 14:58:52.265869 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f050b0e77a1c4b7db5ea2c4089b2440b" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
I20260811 14:58:52.265964 25918 raft_consensus.cc:3037] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.266005 26188 raft_consensus.cc:3037] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.266908 25918 raft_consensus.cc:2454] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.267052 26188 raft_consensus.cc:2454] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.267282 25512 leader_election.cc:302] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706cffbb1e8c4bd59b4a4f9782e1490e, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.267498 26338 raft_consensus.cc:2781] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:52.267635 26338 raft_consensus.cc:686] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 LEADER]: Becoming Leader. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Running, Role: LEADER
I20260811 14:58:52.267782 26338 consensus_queue.cc:237] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.268594 26384 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: TxnStatusTablet state changed. Reason: New leader 706cffbb1e8c4bd59b4a4f9782e1490e. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.268704 26384 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:52.269012 26408 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 14:58:52.269234 26408 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 14:58:52.269680 25330 catalog_manager.cc:5495] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e reported cstate change: term changed from 0 to 1, leader changed from <none> to 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65). New cstate: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:52.285976 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.281930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34718 (local address 127.11.225.65:44123)
0811 14:58:52.282076 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.282079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.282102 (+ 23us) server_negotiation.cc:407] Connection header received
0811 14:58:52.282268 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.282270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.282319 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.282401 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.282682 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.283196 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.284414 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.284718 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.284799 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.285140 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.285579 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.285670 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.285828 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.285874 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 14:58:52.286095 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.281812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.0.0.1:34718)
0811 14:58:52.282000 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.282017 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.282124 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.282449 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.282452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.282460 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:52.282578 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.282584 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.283313 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.283316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.284276 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.284288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.284827 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.284831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.284937 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.284994 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.285693 (+ 699us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.285713 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.285809 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.285928 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 14:58:52.288924 25918 raft_consensus.cc:1261] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.289160 26188 raft_consensus.cc:1261] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.289446 26338 consensus_queue.cc:1035] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.289685 26384 consensus_queue.cc:1035] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.290966 26343 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: TxnStatusTablet state changed. Reason: New leader 706cffbb1e8c4bd59b4a4f9782e1490e. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.291088 26343 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.291304 26363 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: TxnStatusTablet state changed. Reason: New leader 706cffbb1e8c4bd59b4a4f9782e1490e. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.291430 26363 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.293141 26384 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.293278 26384 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:52.293486 26354 mvcc.cc:205] Tried to move back new op lower bound from 7317341521050513408 to 7317341520970407936. Current Snapshot: MvccSnapshot[applied={T|T < 7317341521050513408}]
I20260811 14:58:52.293689 26343 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.293789 26343 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 7687ed51bbb44df294ca604d57ed2ed0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.297057 26350 mvcc.cc:205] Tried to move back new op lower bound from 7317341521050513408 to 7317341520970407936. Current Snapshot: MvccSnapshot[applied={T|T < 7317341521050513408 or (T in {7317341521050513408})}]
I20260811 14:58:52.297812 26338 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.297940 26338 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 706cffbb1e8c4bd59b4a4f9782e1490e: This TxnStatusTablet replica's current role is: LEADER
I20260811 14:58:52.299882 26363 tablet_replica.cc:439] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } } }
I20260811 14:58:52.300215 26363 tablet_replica.cc:442] T f050b0e77a1c4b7db5ea2c4089b2440b P 6d415a03fbec43acb1f6ccd5cf6a211b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 14:58:52.302049 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.297955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.11.225.65:44123)
0811 14:58:52.298089 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.298093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.298105 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:52.298148 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.298150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.298186 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.298271 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.298552 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.299284 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.300500 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.300843 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.300952 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.301371 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.301459 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.301557 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.301685 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.301743 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 14:58:52.312924 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.309296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36885 (local address 127.11.225.65:44123)
0811 14:58:52.309412 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.309417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.309615 (+ 198us) server_negotiation.cc:407] Connection header received
0811 14:58:52.309818 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.309821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.309869 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.309946 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.310181 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.310942 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.311811 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.312144 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.312242 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.312519 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.312598 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.312673 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.312756 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.312803 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 14:58:52.312925 26418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.309202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.11.225.65:36885)
0811 14:58:52.309517 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.309529 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.309669 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.309966 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.309968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.309974 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 14:58:52.310081 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.310085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.311065 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.311067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.311676 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.311684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.312260 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.312263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.312341 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.312381 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.312685 (+ 304us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.312690 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.312739 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.312797 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":111,"threads_started":1}
I20260811 14:58:52.320957 25918 raft_consensus.cc:1261] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.320976 26188 raft_consensus.cc:1261] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.321441 26419 consensus_queue.cc:1035] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.321609 26338 consensus_queue.cc:1035] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.359601 25329 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.359771 25329 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.361948 25329 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Sending DeleteTablet for 3 replicas of tablet db869f79e0a448a085644d8a84401f58
I20260811 14:58:52.362540 25610 tablet_service.cc:1514] Processing DeleteTablet for tablet db869f79e0a448a085644d8a84401f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:34710
I20260811 14:58:52.362740 26368 tablet_replica.cc:330] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: stopping tablet replica
I20260811 14:58:52.362841 25881 tablet_service.cc:1514] Processing DeleteTablet for tablet db869f79e0a448a085644d8a84401f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:38254
I20260811 14:58:52.362882 26368 raft_consensus.cc:2229] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:52.363029 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet db869f79e0a448a085644d8a84401f58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:56336
I20260811 14:58:52.363194 26368 raft_consensus.cc:2258] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.363229 26370 tablet_replica.cc:330] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: stopping tablet replica
I20260811 14:58:52.363344 26370 raft_consensus.cc:2229] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.363377 26367 tablet_replica.cc:330] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: stopping tablet replica
I20260811 14:58:52.363453 26370 raft_consensus.cc:2258] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.363487 26367 raft_consensus.cc:2229] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.363591 26367 raft_consensus.cc:2258] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.364354 26370 ts_tablet_manager.cc:1905] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.364389 26367 ts_tablet_manager.cc:1905] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.367205 26370 ts_tablet_manager.cc:1918] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:52.367273 26370 log.cc:1196] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/db869f79e0a448a085644d8a84401f58
I20260811 14:58:52.367524 26370 ts_tablet_manager.cc:1939] T db869f79e0a448a085644d8a84401f58 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting consensus metadata
I20260811 14:58:52.367789 26367 ts_tablet_manager.cc:1918] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:52.367864 26367 log.cc:1196] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/db869f79e0a448a085644d8a84401f58
I20260811 14:58:52.368225 25306 catalog_manager.cc:4841] TS 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625): tablet db869f79e0a448a085644d8a84401f58 (table test-table [id=a069bfd7afae405b8850a9271e2a1f73]) successfully deleted
I20260811 14:58:52.368999 26368 ts_tablet_manager.cc:1905] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.369565 26367 ts_tablet_manager.cc:1939] T db869f79e0a448a085644d8a84401f58 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting consensus metadata
I20260811 14:58:52.372264 26368 ts_tablet_manager.cc:1918] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:52.372351 26368 log.cc:1196] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/db869f79e0a448a085644d8a84401f58
I20260811 14:58:52.372664 26368 ts_tablet_manager.cc:1939] T db869f79e0a448a085644d8a84401f58 P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting consensus metadata
I20260811 14:58:52.373359 25306 catalog_manager.cc:4841] TS 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255): tablet db869f79e0a448a085644d8a84401f58 (table test-table [id=a069bfd7afae405b8850a9271e2a1f73]) successfully deleted
I20260811 14:58:52.373359 25303 catalog_manager.cc:4841] TS 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123): tablet db869f79e0a448a085644d8a84401f58 (table test-table [id=a069bfd7afae405b8850a9271e2a1f73]) successfully deleted
Aug 11 14:58:52 dist-test-slave-8hhm krb5kdc[25240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 14:58:52 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:52 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:58:52.395978 25429 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:52.388783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51874 (local address 127.11.225.126:43611)
0811 14:58:52.388939 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.388943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.389149 (+ 206us) server_negotiation.cc:407] Connection header received
0811 14:58:52.389358 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.389360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.389404 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.389474 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:52.390371 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.390883 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.392103 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.392315 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.392452 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.395843 (+ 3391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51874: BlockingRecv error: recv got EOF from 127.0.0.1:51874 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 14:58:52 dist-test-slave-8hhm krb5kdc[25240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM
I20260811 14:58:52.406787 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.397469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51884 (local address 127.11.225.126:43611)
0811 14:58:52.397758 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.397763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.398187 (+ 424us) server_negotiation.cc:407] Connection header received
0811 14:58:52.398294 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.398296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.398334 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.398400 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:52.399132 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.399615 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.400719 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.400920 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.401003 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.403612 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:52.403616 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:52.403618 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:52.403650 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:52.405110 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:52.405566 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:52.405570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:52.405572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:52.405656 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:52.405940 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:52.405944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:52.405945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:52.406123 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:52.406267 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.406505 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.406625 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 14:58:52.409502 25329 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:52.410009 25329 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:52.415414 25610 tablet_service.cc:1467] Processing CreateTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (DEFAULT_TABLE table=test-table [id=47a9786707fc4a3fa3769a683493e1fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.415386 25881 tablet_service.cc:1467] Processing CreateTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (DEFAULT_TABLE table=test-table [id=47a9786707fc4a3fa3769a683493e1fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.415704 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.415702 25610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.418246 26327 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Bootstrap starting.
I20260811 14:58:52.418442 26329 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Bootstrap starting.
I20260811 14:58:52.419256 26327 tablet_bootstrap.cc:654] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.419350 26329 tablet_bootstrap.cc:654] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.420708 26145 tablet_service.cc:1467] Processing CreateTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (DEFAULT_TABLE table=test-table [id=47a9786707fc4a3fa3769a683493e1fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.421061 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.421432 26327 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: No bootstrap required, opened a new log
I20260811 14:58:52.421521 26327 ts_tablet_manager.cc:1397] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:52.421936 26327 raft_consensus.cc:348] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.422046 26327 raft_consensus.cc:374] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.422076 26327 raft_consensus.cc:729] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.422188 26327 consensus_queue.cc:260] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.422484 26327 ts_tablet_manager.cc:1428] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.423595 26330 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Bootstrap starting.
I20260811 14:58:52.424489 26330 tablet_bootstrap.cc:654] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.426025 26330 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: No bootstrap required, opened a new log
I20260811 14:58:52.426143 26330 ts_tablet_manager.cc:1397] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:52.426597 26330 raft_consensus.cc:348] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.426760 26330 raft_consensus.cc:374] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.426802 26330 raft_consensus.cc:729] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.426945 26330 consensus_queue.cc:260] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.427258 26330 ts_tablet_manager.cc:1428] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.433995 26329 tablet_bootstrap.cc:492] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: No bootstrap required, opened a new log
I20260811 14:58:52.434121 26329 ts_tablet_manager.cc:1397] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260811 14:58:52.434609 26329 raft_consensus.cc:348] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.434732 26329 raft_consensus.cc:374] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.434772 26329 raft_consensus.cc:729] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.434942 26329 consensus_queue.cc:260] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.435211 26329 ts_tablet_manager.cc:1428] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.627775 26343 raft_consensus.cc:482] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:52.627986 26343 raft_consensus.cc:504] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.629252 26343 leader_election.cc:288] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.633888 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.629592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:35171 (local address 127.11.225.65:44123)
0811 14:58:52.629737 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.629741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.629854 (+ 113us) server_negotiation.cc:407] Connection header received
0811 14:58:52.630014 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.630018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.630076 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.630155 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.630443 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.631206 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.632631 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.633323 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.633451 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.633511 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.633702 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.633776 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:58:52.633904 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.629431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.11.225.66:35171)
0811 14:58:52.629743 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.629758 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.629883 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.630179 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.630182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.630202 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.630334 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.630342 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.631309 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.631313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.632503 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.632513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.633445 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.633448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.633564 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.633587 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.633683 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.633754 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":76,"threads_started":1}
I20260811 14:58:52.634442 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.629526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:35625 (local address 127.11.225.66:51373)
0811 14:58:52.629923 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:52.629954 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:52.630057 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:52.630345 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:52.630347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:52.630362 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:58:52.630932 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.630942 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.631910 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.631912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.633075 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:52.633085 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.634069 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.634072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:52.634175 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.634194 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 14:58:52.634257 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 14:58:52.634316 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":80,"threads_started":1}
I20260811 14:58:52.634800 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.629616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:51373 (local address 127.11.225.67:35625)
0811 14:58:52.629896 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.629900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.630039 (+ 139us) server_negotiation.cc:407] Connection header received
0811 14:58:52.630178 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.630181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.630231 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.630325 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:58:52.631061 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.631793 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.633258 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.633845 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.633956 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.634012 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.634601 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.634677 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":62,"threads_started":1}
I20260811 14:58:52.634999 25655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d8b113d7ee4f8ea4f64ad10cfe97ae" candidate_uuid: "7687ed51bbb44df294ca604d57ed2ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" is_pre_election: true
I20260811 14:58:52.635187 25655 raft_consensus.cc:2454] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7687ed51bbb44df294ca604d57ed2ed0 in term 0.
I20260811 14:58:52.635164 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d8b113d7ee4f8ea4f64ad10cfe97ae" candidate_uuid: "7687ed51bbb44df294ca604d57ed2ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" is_pre_election: true
I20260811 14:58:52.635295 26188 raft_consensus.cc:2454] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7687ed51bbb44df294ca604d57ed2ed0 in term 0.
I20260811 14:58:52.635637 25782 leader_election.cc:302] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 706cffbb1e8c4bd59b4a4f9782e1490e, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.635896 26343 raft_consensus.cc:2781] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:52.635960 26343 raft_consensus.cc:482] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:52.636004 26343 raft_consensus.cc:3037] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.637261 26343 raft_consensus.cc:504] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.637605 26343 leader_election.cc:288] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [CANDIDATE]: Term 1 election: Requested vote from peers 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.637920 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d8b113d7ee4f8ea4f64ad10cfe97ae" candidate_uuid: "7687ed51bbb44df294ca604d57ed2ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
I20260811 14:58:52.638038 26188 raft_consensus.cc:3037] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.639125 26188 raft_consensus.cc:2454] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7687ed51bbb44df294ca604d57ed2ed0 in term 1.
I20260811 14:58:52.639346 25655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d8b113d7ee4f8ea4f64ad10cfe97ae" candidate_uuid: "7687ed51bbb44df294ca604d57ed2ed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e"
I20260811 14:58:52.639400 25784 leader_election.cc:302] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.639447 25655 raft_consensus.cc:3037] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.639570 26343 raft_consensus.cc:2781] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:52.639765 26343 raft_consensus.cc:686] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 LEADER]: Becoming Leader. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Running, Role: LEADER
I20260811 14:58:52.640018 26343 consensus_queue.cc:237] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.640507 25655 raft_consensus.cc:2454] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7687ed51bbb44df294ca604d57ed2ed0 in term 1.
I20260811 14:58:52.642439 25329 catalog_manager.cc:5495] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66). New cstate: current_term: 1 leader_uuid: "7687ed51bbb44df294ca604d57ed2ed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:52.660773 26468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.657165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38260 (local address 127.11.225.66:38255)
0811 14:58:52.657436 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.657442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.657455 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:52.657530 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.657533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.657580 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.657680 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.657885 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.658382 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.659264 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.659523 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.659657 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.659955 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.660376 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.660491 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.660528 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.660575 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":117,"threads_started":1}
I20260811 14:58:52.663441 25655 raft_consensus.cc:1261] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Refusing update from remote peer 7687ed51bbb44df294ca604d57ed2ed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.663516 26188 raft_consensus.cc:1261] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Refusing update from remote peer 7687ed51bbb44df294ca604d57ed2ed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.663921 26464 consensus_queue.cc:1035] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.664131 26343 consensus_queue.cc:1035] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.675571 25328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.675693 25328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.677752 25328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Sending DeleteTablet for 3 replicas of tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae
I20260811 14:58:52.678334 25610 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:34710
I20260811 14:58:52.678440 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:56336
I20260811 14:58:52.678544 26368 tablet_replica.cc:330] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: stopping tablet replica
I20260811 14:58:52.678663 26368 raft_consensus.cc:2229] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.678702 25881 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:38254
I20260811 14:58:52.678838 26368 raft_consensus.cc:2258] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.678910 26370 tablet_replica.cc:330] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: stopping tablet replica
I20260811 14:58:52.679085 26370 raft_consensus.cc:2229] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.679235 26370 raft_consensus.cc:2258] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.679422 26367 tablet_replica.cc:330] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: stopping tablet replica
I20260811 14:58:52.679553 26367 raft_consensus.cc:2229] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:52.679558 26368 ts_tablet_manager.cc:1905] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.679847 26367 raft_consensus.cc:2258] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.680579 26367 ts_tablet_manager.cc:1905] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.680898 25328 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:58:52.681385 25328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:58:52.682140 26368 ts_tablet_manager.cc:1918] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.682211 26368 log.cc:1196] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/f7d8b113d7ee4f8ea4f64ad10cfe97ae
I20260811 14:58:52.682464 26368 ts_tablet_manager.cc:1939] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 706cffbb1e8c4bd59b4a4f9782e1490e: Deleting consensus metadata
I20260811 14:58:52.683169 26370 ts_tablet_manager.cc:1905] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.683202 26367 ts_tablet_manager.cc:1918] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.683261 26367 log.cc:1196] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/f7d8b113d7ee4f8ea4f64ad10cfe97ae
I20260811 14:58:52.683446 25303 catalog_manager.cc:4841] TS 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123): tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (table test-table [id=47a9786707fc4a3fa3769a683493e1fd]) successfully deleted
I20260811 14:58:52.683954 26367 ts_tablet_manager.cc:1939] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 7687ed51bbb44df294ca604d57ed2ed0: Deleting consensus metadata
I20260811 14:58:52.684640 25306 catalog_manager.cc:4841] TS 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255): tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (table test-table [id=47a9786707fc4a3fa3769a683493e1fd]) successfully deleted
I20260811 14:58:52.685842 26370 ts_tablet_manager.cc:1918] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:58:52.685921 26370 log.cc:1196] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/f7d8b113d7ee4f8ea4f64ad10cfe97ae
I20260811 14:58:52.686226 26370 ts_tablet_manager.cc:1939] T f7d8b113d7ee4f8ea4f64ad10cfe97ae P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting consensus metadata
I20260811 14:58:52.686826 25306 catalog_manager.cc:4841] TS 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625): tablet f7d8b113d7ee4f8ea4f64ad10cfe97ae (table test-table [id=47a9786707fc4a3fa3769a683493e1fd]) successfully deleted
I20260811 14:58:52.687471 25610 tablet_service.cc:1467] Processing CreateTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 (DEFAULT_TABLE table=test-table [id=969d64cb9ec54d529ea081716f9ac94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.687538 25881 tablet_service.cc:1467] Processing CreateTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 (DEFAULT_TABLE table=test-table [id=969d64cb9ec54d529ea081716f9ac94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.687666 25610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223eb2d35bb34e5b81d2e88968ceeac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.687767 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223eb2d35bb34e5b81d2e88968ceeac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.689347 26327 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: Bootstrap starting.
I20260811 14:58:52.689878 26329 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Bootstrap starting.
I20260811 14:58:52.690074 26145 tablet_service.cc:1467] Processing CreateTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 (DEFAULT_TABLE table=test-table [id=969d64cb9ec54d529ea081716f9ac94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:58:52.690238 26327 tablet_bootstrap.cc:654] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.690333 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 223eb2d35bb34e5b81d2e88968ceeac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:52.690783 26329 tablet_bootstrap.cc:654] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.691588 26327 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: No bootstrap required, opened a new log
I20260811 14:58:52.691668 26327 ts_tablet_manager.cc:1397] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:52.692071 26327 raft_consensus.cc:348] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.692188 26327 raft_consensus.cc:374] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.692222 26327 raft_consensus.cc:729] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.692351 26327 consensus_queue.cc:260] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.692662 26327 ts_tablet_manager.cc:1428] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 14:58:52.693361 26330 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Bootstrap starting.
I20260811 14:58:52.694113 26330 tablet_bootstrap.cc:654] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:52.695516 26330 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: No bootstrap required, opened a new log
I20260811 14:58:52.695626 26330 ts_tablet_manager.cc:1397] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:52.696022 26330 raft_consensus.cc:348] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.696156 26330 raft_consensus.cc:374] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.696216 26330 raft_consensus.cc:729] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d415a03fbec43acb1f6ccd5cf6a211b, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.696347 26330 consensus_queue.cc:260] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.696673 26330 ts_tablet_manager.cc:1428] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 14:58:52.697578 26329 tablet_bootstrap.cc:492] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: No bootstrap required, opened a new log
I20260811 14:58:52.697665 26329 ts_tablet_manager.cc:1397] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260811 14:58:52.698107 26329 raft_consensus.cc:348] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.698220 26329 raft_consensus.cc:374] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:52.698257 26329 raft_consensus.cc:729] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7687ed51bbb44df294ca604d57ed2ed0, State: Initialized, Role: FOLLOWER
I20260811 14:58:52.698374 26329 consensus_queue.cc:260] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.698652 26329 ts_tablet_manager.cc:1428] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 14:58:52.886112 26419 raft_consensus.cc:482] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:58:52.886279 26419 raft_consensus.cc:504] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.886770 26419 leader_election.cc:288] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.887135 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "223eb2d35bb34e5b81d2e88968ceeac2" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0" is_pre_election: true
I20260811 14:58:52.887279 25918 raft_consensus.cc:2454] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.887265 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "223eb2d35bb34e5b81d2e88968ceeac2" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" is_pre_election: true
I20260811 14:58:52.887428 26188 raft_consensus.cc:2454] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 0.
I20260811 14:58:52.887595 25512 leader_election.cc:302] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706cffbb1e8c4bd59b4a4f9782e1490e, 7687ed51bbb44df294ca604d57ed2ed0; no voters:
I20260811 14:58:52.887794 26419 raft_consensus.cc:2781] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:58:52.887857 26419 raft_consensus.cc:482] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:58:52.887894 26419 raft_consensus.cc:3037] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.889673 26419 raft_consensus.cc:504] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.889991 26419 leader_election.cc:288] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Requested vote from peers 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255), 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625)
I20260811 14:58:52.890607 26188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "223eb2d35bb34e5b81d2e88968ceeac2" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b"
I20260811 14:58:52.890743 26188 raft_consensus.cc:3037] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.891124 25918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "223eb2d35bb34e5b81d2e88968ceeac2" candidate_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7687ed51bbb44df294ca604d57ed2ed0"
I20260811 14:58:52.891244 25918 raft_consensus.cc:3037] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:52.892151 26188 raft_consensus.cc:2454] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.892385 25918 raft_consensus.cc:2454] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706cffbb1e8c4bd59b4a4f9782e1490e in term 1.
I20260811 14:58:52.892483 25512 leader_election.cc:302] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d415a03fbec43acb1f6ccd5cf6a211b, 706cffbb1e8c4bd59b4a4f9782e1490e; no voters:
I20260811 14:58:52.892776 26419 raft_consensus.cc:2781] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:52.892956 26419 raft_consensus.cc:686] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 LEADER]: Becoming Leader. State: Replica: 706cffbb1e8c4bd59b4a4f9782e1490e, State: Running, Role: LEADER
I20260811 14:58:52.893118 26419 consensus_queue.cc:237] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } }
I20260811 14:58:52.894892 25328 catalog_manager.cc:5495] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e reported cstate change: term changed from 0 to 1, leader changed from <none> to 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65). New cstate: current_term: 1 leader_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706cffbb1e8c4bd59b4a4f9782e1490e" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 } health_report { overall_health: UNKNOWN } } }
I20260811 14:58:52.941339 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:52.938565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34738 (local address 127.11.225.65:44123)
0811 14:58:52.938684 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:52.938687 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:52.938699 (+ 12us) server_negotiation.cc:407] Connection header received
0811 14:58:52.938817 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:52.938818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:52.938866 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:52.938929 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:58:52.939186 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.939655 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.940418 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:52.940626 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:52.940704 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:52.940904 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:58:52.940967 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:58:52.941055 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:52.941123 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 14:58:52.941163 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 14:58:52.947499 26188 raft_consensus.cc:1261] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.947527 25918 raft_consensus.cc:1261] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Refusing update from remote peer 706cffbb1e8c4bd59b4a4f9782e1490e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:58:52.947893 26484 consensus_queue.cc:1035] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d415a03fbec43acb1f6ccd5cf6a211b" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 35625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.948058 26419 consensus_queue.cc:1035] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7687ed51bbb44df294ca604d57ed2ed0" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 38255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:58:52.978349 25328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.978518 25328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:58:52.980479 25328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce074d7798c54cab86a836a32cb7bb7d: Sending DeleteTablet for 3 replicas of tablet 223eb2d35bb34e5b81d2e88968ceeac2
I20260811 14:58:52.981088 25610 tablet_service.cc:1514] Processing DeleteTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:34710
I20260811 14:58:52.981122 25881 tablet_service.cc:1514] Processing DeleteTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:38254
I20260811 14:58:52.981315 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet 223eb2d35bb34e5b81d2e88968ceeac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:58:52 UTC) from {username='oryx', principal='oryx/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:56336
I20260811 14:58:52.981544 26368 tablet_replica.cc:330] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e: stopping tablet replica
I20260811 14:58:52.981688 26368 raft_consensus.cc:2229] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:58:52.981758 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 25468
I20260811 14:58:52.981905 26368 raft_consensus.cc:2258] T 223eb2d35bb34e5b81d2e88968ceeac2 P 706cffbb1e8c4bd59b4a4f9782e1490e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.982095 26370 tablet_replica.cc:330] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: stopping tablet replica
I20260811 14:58:52.982239 26370 raft_consensus.cc:2229] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.982342 26370 raft_consensus.cc:2258] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.989728 26367 tablet_replica.cc:330] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: stopping tablet replica
I20260811 14:58:52.989871 26367 raft_consensus.cc:2229] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:58:52.989979 26367 raft_consensus.cc:2258] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:58:52.994644 26370 ts_tablet_manager.cc:1905] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.996742 26370 ts_tablet_manager.cc:1918] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:52.996814 26370 log.cc:1196] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/223eb2d35bb34e5b81d2e88968ceeac2
I20260811 14:58:52.997102 26370 ts_tablet_manager.cc:1939] T 223eb2d35bb34e5b81d2e88968ceeac2 P 6d415a03fbec43acb1f6ccd5cf6a211b: Deleting consensus metadata
I20260811 14:58:52.997790 26367 ts_tablet_manager.cc:1905] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:58:52.997876 25306 catalog_manager.cc:4841] TS 6d415a03fbec43acb1f6ccd5cf6a211b (127.11.225.67:35625): tablet 223eb2d35bb34e5b81d2e88968ceeac2 (table test-table [id=969d64cb9ec54d529ea081716f9ac94a]) successfully deleted
I20260811 14:58:53.001065 26367 ts_tablet_manager.cc:1918] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 14:58:53.001165 26367 log.cc:1196] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/223eb2d35bb34e5b81d2e88968ceeac2
I20260811 14:58:53.001457 26367 ts_tablet_manager.cc:1939] T 223eb2d35bb34e5b81d2e88968ceeac2 P 7687ed51bbb44df294ca604d57ed2ed0: Deleting consensus metadata
I20260811 14:58:53.002241 25306 catalog_manager.cc:4841] TS 7687ed51bbb44df294ca604d57ed2ed0 (127.11.225.66:38255): tablet 223eb2d35bb34e5b81d2e88968ceeac2 (table test-table [id=969d64cb9ec54d529ea081716f9ac94a]) successfully deleted
I20260811 14:58:53.003720 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 25744
W20260811 14:58:53.003684 25303 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:44123 (error 108)
I20260811 14:58:53.015698 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:53.014952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44123 (local address 127.0.0.1:34754)
0811 14:58:53.015473 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:53.015569 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":359,"threads_started":1}
W20260811 14:58:53.017714 25303 catalog_manager.cc:4584] TS 706cffbb1e8c4bd59b4a4f9782e1490e (127.11.225.65:44123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 223eb2d35bb34e5b81d2e88968ceeac2: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44123: connect: Connection refused (error 111)
I20260811 14:58:53.023829 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 26021
I20260811 14:58:53.040675 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 25265
2026-08-11T14:58:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3552 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:53 dist-test-slave-8hhm krb5kdc[26500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:53 dist-test-slave-8hhm krb5kdc[26500](info): set up 2 sockets
Aug 11 14:58:53 dist-test-slave-8hhm krb5kdc[26500](info): commencing operation
krb5kdc: starting...
W20260811 14:58:54.330308 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:54 dist-test-slave-8hhm krb5kdc[26500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:54.464161 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42447
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:42447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:54.576686 26526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:54.576951 26526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:54.577009 26526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:54.580904 26526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:54.580958 26526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:54.580978 26526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:54.580994 26526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:54.581009 26526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:54.586087 26526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:42447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:54.587078 26526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:54.588052 26526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:54.596354 26543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:54.596362 26538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:54.596505 26526 server_base.cc:1034] running on GCE node
W20260811 14:58:54.596362 26549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:54.597174 26526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:54.598356 26526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:54.599524 26526 hybrid_clock.cc:648] HybridClock initialized: now 1786460334599493 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T14:58:54Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1565 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:58:54 dist-test-slave-8hhm krb5kdc[26562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:58:54 dist-test-slave-8hhm krb5kdc[26562](info): set up 2 sockets
Aug 11 14:58:54 dist-test-slave-8hhm krb5kdc[26562](info): commencing operation
krb5kdc: starting...
W20260811 14:58:55.893311 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:58:55 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:58:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:58:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:58:56.020097 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43465
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:56.132629 26600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:56.132918 26600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:56.132999 26600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:56.136876 26600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:56.136960 26600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:56.137010 26600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:56.137081 26600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:56.137118 26600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:56.142333 26600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:56.143385 26600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:56.144384 26600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:56.152915 26610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.152872 26612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.152876 26608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:56.153123 26600 server_base.cc:1034] running on GCE node
I20260811 14:58:56.153859 26600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:56.154888 26600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:56.156078 26600 hybrid_clock.cc:648] HybridClock initialized: now 1786460336156064 us; error 25 us; skew 500 ppm
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:56.158958 26600 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:56.159822 26600 webserver.cc:460] Webserver started at http://127.11.225.126:42525/ using document root <none> and password file <none>
I20260811 14:58:56.160326 26600 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:56.160382 26600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:56.160552 26600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:56.162569 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "503848482f794e47b207d02110af4043"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "f02f3d9cdd09d749cc3eed0e5d7b4501"
server_key_iv: "14d8b3a25167d6f77135f6cf6947c852"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.163093 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "503848482f794e47b207d02110af4043"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "f02f3d9cdd09d749cc3eed0e5d7b4501"
server_key_iv: "14d8b3a25167d6f77135f6cf6947c852"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.166714 26600 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:56.168973 26628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.170213 26600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:56.170354 26600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "503848482f794e47b207d02110af4043"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "f02f3d9cdd09d749cc3eed0e5d7b4501"
server_key_iv: "14d8b3a25167d6f77135f6cf6947c852"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.170460 26600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:56.180559 26600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:56.183656 26600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:56.183854 26600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:56.191308 26600 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:43465
I20260811 14:58:56.191326 26725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:43465 every 8 connection(s)
I20260811 14:58:56.192206 26600 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:56.194955 26726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:58:56.196622 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 26600
I20260811 14:58:56.196761 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:58:56.197050 12165 external_mini_cluster.cc:1428] Setting key da0517b6f723fd63e614c72477516f2b
I20260811 14:58:56.201443 26726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Bootstrap starting.
I20260811 14:58:56.204363 26726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Neither blocks nor log segments found. Creating new log.
I20260811 14:58:56.205334 26726 log.cc:824] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Log is configured to *not* fsync() on all Append() calls
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:56.207238 26726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: No bootstrap required, opened a new log
I20260811 14:58:56.210741 26726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:56.210974 26726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:58:56.211052 26726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503848482f794e47b207d02110af4043, State: Initialized, Role: FOLLOWER
I20260811 14:58:56.211112 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.198363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48152 (local address 127.11.225.126:43465)
0811 14:58:56.198782 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:56.198797 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:56.198831 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:58:56.199432 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:56.199447 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:56.199742 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:56.200002 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:56.200892 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.201982 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.203159 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.203606 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.203714 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.206603 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:56.206609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:56.206621 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:56.206647 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:56.208328 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.208782 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.208787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.208791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.208896 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.209184 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.209187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.209189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.209626 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:56.209834 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:56.210073 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 14:58:56.210336 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":164,"threads_started":1}
I20260811 14:58:56.211578 26726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:56.211761 26726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:56.211828 26726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:56.211920 26726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:58:56.212774 26726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:56.213137 26726 leader_election.cc:302] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 503848482f794e47b207d02110af4043; no voters:
I20260811 14:58:56.213518 26726 leader_election.cc:288] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:58:56.213559 26740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:58:56.213819 26740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 LEADER]: Becoming Leader. State: Replica: 503848482f794e47b207d02110af4043, State: Running, Role: LEADER
I20260811 14:58:56.214159 26740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:56.214666 26726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:56.215775 26742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "503848482f794e47b207d02110af4043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } } }
I20260811 14:58:56.215910 26742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:56.216295 26759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:56.216261 26743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503848482f794e47b207d02110af4043. Latest consensus state: current_term: 1 leader_uuid: "503848482f794e47b207d02110af4043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } } }
I20260811 14:58:56.216869 26743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:56.219501 26759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:56.224525 26759 catalog_manager.cc:1347] Generated new cluster ID: ffd0ba9d96ba444b8f23e1f3e02b12fb
I20260811 14:58:56.224594 26759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:56.240401 26759 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:58:56.241339 26759 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:56.247841 26759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Generated new TSK 0
I20260811 14:58:56.248575 26759 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:58:56.288796 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:56.402135 26779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:56.402369 26779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:56.402406 26779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:56.406338 26779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:56.406389 26779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:56.406445 26779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:56.411305 26779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:56.412210 26779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:56.413117 26779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:56.422864 26797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.422937 26790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.422864 26787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:56.422955 26779 server_base.cc:1034] running on GCE node
I20260811 14:58:56.423516 26779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:56.424206 26779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:56.425390 26779 hybrid_clock.cc:648] HybridClock initialized: now 1786460336425378 us; error 30 us; skew 500 ppm
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:56.428104 26779 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:58:56.428951 26779 webserver.cc:460] Webserver started at http://127.11.225.65:36331/ using document root <none> and password file <none>
I20260811 14:58:56.429546 26779 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:56.429608 26779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:56.429778 26779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:56.431783 26779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "5c80288431bd44a1944cbe95b7ebb84e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "46e4c0c70840d30cf29367247a1d0526"
server_key_iv: "11f1d65591cea01facc824ec87c38578"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.432322 26779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "5c80288431bd44a1944cbe95b7ebb84e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "46e4c0c70840d30cf29367247a1d0526"
server_key_iv: "11f1d65591cea01facc824ec87c38578"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.436031 26779 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 14:58:56.438508 26805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.439720 26779 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:58:56.439817 26779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "5c80288431bd44a1944cbe95b7ebb84e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "46e4c0c70840d30cf29367247a1d0526"
server_key_iv: "11f1d65591cea01facc824ec87c38578"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.439947 26779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:56.461185 26779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:56.464300 26779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:56.464501 26779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:56.465106 26779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:56.465938 26779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:56.465986 26779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.466025 26779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:56.466040 26779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.475037 26779 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:33093
I20260811 14:58:56.475147 27004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:33093 every 8 connection(s)
I20260811 14:58:56.475960 26779 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:56.485459 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 26779
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:56.485622 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:58:56.485917 12165 external_mini_cluster.cc:1428] Setting key 6cceeaed226af926d8b94d0e50372f0c
I20260811 14:58:56.490293 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.477707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33635 (local address 127.11.225.126:43465)
0811 14:58:56.477869 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:56.477872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:56.479164 (+ 1292us) server_negotiation.cc:407] Connection header received
0811 14:58:56.480086 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:56.480090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:56.480159 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:56.480260 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:56.481545 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.482084 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.483261 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.483493 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.483609 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.486258 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:56.486262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:56.486264 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:56.486294 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:56.488019 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.488517 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.488523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.488528 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.488629 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.489018 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.489024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.489028 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.489317 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:56.489429 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:56.489954 (+ 525us) server_negotiation.cc:299] Negotiation successful
0811 14:58:56.490089 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 14:58:56.491190 27010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.478098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:33635)
0811 14:58:56.478988 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:56.479057 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:56.479877 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:56.480486 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:56.480493 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:56.480835 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:56.481391 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.481405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.482233 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.482236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.483124 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.483133 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.483652 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.483656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.483826 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.484446 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:56.484462 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:56.486065 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:56.488140 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.488144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.488155 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.488406 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.488761 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.488763 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.488765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.488911 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.489448 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:56.489454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:56.489690 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 14:58:56.489906 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 14:58:56.490311 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":538,"threads_started":1}
I20260811 14:58:56.492548 27005 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43465
I20260811 14:58:56.492841 27005 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:56.493515 27005 heartbeater.cc:511] Master 127.11.225.126:43465 requested a full tablet report, sending...
I20260811 14:58:56.495410 26659 ts_manager.cc:194] Registered new tserver with Master: 5c80288431bd44a1944cbe95b7ebb84e (127.11.225.65:33093)
I20260811 14:58:56.497097 26659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:33635
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:58:56.516331 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:56.630045 27016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:56.630273 27016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:56.630312 27016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:56.634141 27016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:56.634188 27016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:56.634243 27016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:56.639262 27016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:56.640182 27016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:56.641094 27016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:56.651218 27032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.651227 27027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.651254 27030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:56.651338 27016 server_base.cc:1034] running on GCE node
I20260811 14:58:56.651782 27016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:56.652427 27016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:56.653614 27016 hybrid_clock.cc:648] HybridClock initialized: now 1786460336653599 us; error 26 us; skew 500 ppm
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:56.656407 27016 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:58:56.657465 27016 webserver.cc:460] Webserver started at http://127.11.225.66:34505/ using document root <none> and password file <none>
I20260811 14:58:56.658056 27016 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:56.658149 27016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:56.658358 27016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:56.660305 27016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "356cae31c47747cfb1defedad04c179e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "8d13629d42869612efb2d30a3afe493b"
server_key_iv: "ca76889cf7cc89763868b52be94080df"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.660872 27016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "356cae31c47747cfb1defedad04c179e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "8d13629d42869612efb2d30a3afe493b"
server_key_iv: "ca76889cf7cc89763868b52be94080df"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.664608 27016 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 14:58:56.667039 27043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.668239 27016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:56.668373 27016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "356cae31c47747cfb1defedad04c179e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "8d13629d42869612efb2d30a3afe493b"
server_key_iv: "ca76889cf7cc89763868b52be94080df"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.668481 27016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:56.694413 27016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:56.697530 27016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:56.697741 27016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:56.698340 27016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:56.699208 27016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:56.699294 27016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.699366 27016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:56.699409 27016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.708851 27016 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:40033
I20260811 14:58:56.708876 27261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:40033 every 8 connection(s)
I20260811 14:58:56.709744 27016 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:56.712672 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 27016
I20260811 14:58:56.712819 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:58:56.713112 12165 external_mini_cluster.cc:1428] Setting key a73948b768acbc38c598f92010d46311
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:58:56.724783 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.711473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:47511 (local address 127.11.225.126:43465)
0811 14:58:56.711616 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:56.711620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:56.712642 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 14:58:56.713727 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:56.713731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:56.713790 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:56.713901 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:56.715388 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.716262 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.718081 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.718300 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.718383 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.721251 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:56.721256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:56.721259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:56.721289 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:56.722720 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.723242 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.723245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.723247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.723329 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.723670 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.723674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.723676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.723873 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:56.723999 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:56.724480 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 14:58:56.724610 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 14:58:56.725636 27265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.711856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:47511)
0811 14:58:56.712474 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:56.712513 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:56.713512 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:56.714093 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:56.714101 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:56.714563 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:56.715183 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.715198 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.716387 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.716390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.717902 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.717916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.718458 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.718464 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.718696 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.719333 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:56.719358 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:56.721047 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:56.722842 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.722848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.722862 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.723134 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.723422 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.723426 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.723428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.723572 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.723999 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:56.724007 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:56.724251 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 14:58:56.724436 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 14:58:56.724741 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":110,"threads_started":1}
I20260811 14:58:56.726909 27262 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43465
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:58:56.727211 27262 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:56.727725 27262 heartbeater.cc:511] Master 127.11.225.126:43465 requested a full tablet report, sending...
I20260811 14:58:56.728749 26659 ts_manager.cc:194] Registered new tserver with Master: 356cae31c47747cfb1defedad04c179e (127.11.225.66:40033)
I20260811 14:58:56.729403 26659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:47511
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:58:56.742364 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:56.860195 27269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:56.860548 27269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:56.860638 27269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:56.868685 27269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:56.868743 27269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:56.868840 27269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:56.874722 27269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:56.875794 27269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:56.876706 27269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:56.887867 27276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.887986 27283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:56.887889 27278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:56.888239 27269 server_base.cc:1034] running on GCE node
I20260811 14:58:56.888739 27269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:56.889655 27269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:56.890849 27269 hybrid_clock.cc:648] HybridClock initialized: now 1786460336890800 us; error 62 us; skew 500 ppm
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:56.894178 27269 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:58:56.895053 27269 webserver.cc:460] Webserver started at http://127.11.225.67:46423/ using document root <none> and password file <none>
I20260811 14:58:56.895565 27269 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:56.895624 27269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:56.895787 27269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:58:56.897850 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "94cc869e45ae47bdb0b84cae03f72b55"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "9b78deef8b70dd87644b7971a2aebc66"
server_key_iv: "251bfe3c43564e418c811d01afad7c3f"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.898368 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "94cc869e45ae47bdb0b84cae03f72b55"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "9b78deef8b70dd87644b7971a2aebc66"
server_key_iv: "251bfe3c43564e418c811d01afad7c3f"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.901925 27269 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 14:58:56.904248 27297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.905509 27269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:56.905603 27269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "94cc869e45ae47bdb0b84cae03f72b55"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "9b78deef8b70dd87644b7971a2aebc66"
server_key_iv: "251bfe3c43564e418c811d01afad7c3f"
server_key_version: "encryptionkey@0"
I20260811 14:58:56.905690 27269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:56.932042 27269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:56.935060 27269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:56.935230 27269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:56.935806 27269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:56.936681 27269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:56.936736 27269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.936775 27269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:56.936793 27269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:56.946234 27269 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:45873
I20260811 14:58:56.946261 27517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:45873 every 8 connection(s)
I20260811 14:58:56.947139 27269 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:56.949764 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 27269
I20260811 14:58:56.949905 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:58:56.950235 12165 external_mini_cluster.cc:1428] Setting key b152f4c5a15af7ad4e61535b8884964c
Aug 11 14:58:56 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460336, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:58:56.960582 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.948820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:39139 (local address 127.11.225.126:43465)
0811 14:58:56.948962 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:56.948966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:56.950135 (+ 1169us) server_negotiation.cc:407] Connection header received
0811 14:58:56.951250 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:56.951254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:56.951312 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:56.951388 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:56.952828 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.953425 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.954563 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.954780 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.954873 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.957310 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:56.957314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:56.957316 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:56.957342 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:56.958820 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.959280 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.959282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.959283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.959359 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:56.959655 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:56.959657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:56.959658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:56.959835 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:56.959914 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:56.960350 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 14:58:56.960445 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:58:56.961440 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:56.949186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:39139)
0811 14:58:56.949973 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:56.950034 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:56.951020 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:56.951621 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:56.951631 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:56.952058 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:56.952683 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.952700 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.953551 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.953554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.954416 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:56.954425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:56.954923 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:56.954926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:56.955069 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:56.955602 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:56.955623 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:56.957102 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:58:56.958930 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.958935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.958946 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.959194 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.959438 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:58:56.959440 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:58:56.959441 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:58:56.959570 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:58:56.959924 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:58:56.959928 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:58:56.960144 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 14:58:56.960296 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 14:58:56.960527 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":134,"threads_started":1}
I20260811 14:58:56.962581 27519 heartbeater.cc:347] Connected to a master server at 127.11.225.126:43465
I20260811 14:58:56.962843 27519 heartbeater.cc:464] Registering TS with master...
I20260811 14:58:56.963425 27519 heartbeater.cc:511] Master 127.11.225.126:43465 requested a full tablet report, sending...
I20260811 14:58:56.964586 26659 ts_manager.cc:194] Registered new tserver with Master: 94cc869e45ae47bdb0b84cae03f72b55 (127.11.225.67:45873)
I20260811 14:58:56.965097 26659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:39139
I20260811 14:58:56.975919 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
Entry for principal oryx/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab.
WARNING: no policy specified for oryx/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
Entry for principal oryx/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab.
WARNING: no policy specified for oryx/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
Entry for principal oryx/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab.
I20260811 14:58:57.052309 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 26779
I20260811 14:58:57.068240 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 27016
I20260811 14:58:57.078073 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 27269
I20260811 14:58:57.101048 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 26600
I20260811 14:58:57.123955 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43465
--webserver_interface=127.11.225.126
--webserver_port=42525
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:58:57.238252 27532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:57.238509 27532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:57.238548 27532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:57.242574 27532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:58:57.242627 27532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:57.242646 27532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:57.242662 27532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:58:57.242677 27532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:58:57.248004 27532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=42525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:57.249131 27532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:57.250209 27532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:57.258746 27544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.258766 27548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.258749 27546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:57.259171 27532 server_base.cc:1034] running on GCE node
I20260811 14:58:57.259752 27532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:57.260881 27532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:57.262038 27532 hybrid_clock.cc:648] HybridClock initialized: now 1786460337261994 us; error 56 us; skew 500 ppm
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460337, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:57.264844 27532 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:58:57.265751 27532 webserver.cc:460] Webserver started at http://127.11.225.126:42525/ using document root <none> and password file <none>
I20260811 14:58:57.266278 27532 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:57.266355 27532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:57.270115 27532 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:58:57.272188 27562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.273676 27532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:57.273803 27532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "503848482f794e47b207d02110af4043"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "f02f3d9cdd09d749cc3eed0e5d7b4501"
server_key_iv: "14d8b3a25167d6f77135f6cf6947c852"
server_key_version: "encryptionkey@0"
I20260811 14:58:57.274366 27532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:57.306990 27532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:57.310609 27532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:57.310855 27532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:57.318289 27532 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:43465
I20260811 14:58:57.318320 27656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:43465 every 8 connection(s)
I20260811 14:58:57.319829 27532 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:58:57.320916 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 27532
I20260811 14:58:57.321487 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:33093
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:43465
--webserver_port=36331
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 14:58:57.325242 27658 sys_catalog.cc:263] Verifying existing consensus state
I20260811 14:58:57.326978 27658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Bootstrap starting.
I20260811 14:58:57.344908 27658 log.cc:824] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Log is configured to *not* fsync() on all Append() calls
I20260811 14:58:57.351763 27658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 14:58:57.352226 27658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Bootstrap complete.
I20260811 14:58:57.356593 27658 raft_consensus.cc:348] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:57.357036 27658 raft_consensus.cc:729] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503848482f794e47b207d02110af4043, State: Initialized, Role: FOLLOWER
I20260811 14:58:57.357625 27658 consensus_queue.cc:260] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:57.357789 27658 raft_consensus.cc:388] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:58:57.357878 27658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:58:57.357996 27658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 1 FOLLOWER]: Advancing to term 2
I20260811 14:58:57.359949 27658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:57.360291 27658 leader_election.cc:302] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 503848482f794e47b207d02110af4043; no voters:
I20260811 14:58:57.360689 27658 leader_election.cc:288] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 14:58:57.360781 27664 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 14:58:57.360984 27664 raft_consensus.cc:686] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [term 2 LEADER]: Becoming Leader. State: Replica: 503848482f794e47b207d02110af4043, State: Running, Role: LEADER
I20260811 14:58:57.361348 27664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } }
I20260811 14:58:57.361994 27658 sys_catalog.cc:564] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:58:57.362733 27666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "503848482f794e47b207d02110af4043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } } }
I20260811 14:58:57.362864 27666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:57.363535 27681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:58:57.363567 27667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503848482f794e47b207d02110af4043. Latest consensus state: current_term: 2 leader_uuid: "503848482f794e47b207d02110af4043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503848482f794e47b207d02110af4043" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43465 } } }
I20260811 14:58:57.363782 27667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043 [sys.catalog]: This master's current role is: LEADER
I20260811 14:58:57.367179 27681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:58:57.368069 27681 catalog_manager.cc:1259] Loaded cluster ID: ffd0ba9d96ba444b8f23e1f3e02b12fb
I20260811 14:58:57.368134 27681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:58:57.370680 27681 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:58:57.371496 27681 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 503848482f794e47b207d02110af4043: Loaded TSK: 0
I20260811 14:58:57.372754 27681 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 14:58:57.443415 27661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:57.443674 27661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:57.443715 27661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:57.447762 27661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:57.447839 27661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:57.447917 27661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:58:57.453135 27661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.65.keytab
--principal=oryx/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:33093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=36331
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:57.454185 27661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:57.455199 27661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:57.466166 27714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.466183 27711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.466176 27709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:57.466379 27661 server_base.cc:1034] running on GCE node
I20260811 14:58:57.466998 27661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:57.467653 27661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:57.468847 27661 hybrid_clock.cc:648] HybridClock initialized: now 1786460337468821 us; error 45 us; skew 500 ppm
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460337, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:57.471769 27661 init.cc:377] Logged in from keytab as oryx/127.11.225.65@KRBTEST.COM (short username oryx)
I20260811 14:58:57.472692 27661 webserver.cc:460] Webserver started at http://127.11.225.65:36331/ using document root <none> and password file <none>
I20260811 14:58:57.473325 27661 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:57.473428 27661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:57.477592 27661 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:57.479928 27726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.481289 27661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:58:57.481417 27661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "5c80288431bd44a1944cbe95b7ebb84e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "46e4c0c70840d30cf29367247a1d0526"
server_key_iv: "11f1d65591cea01facc824ec87c38578"
server_key_version: "encryptionkey@0"
I20260811 14:58:57.481962 27661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:57.499382 27661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:57.502791 27661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:57.503015 27661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:57.503649 27661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:57.504599 27661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:57.504673 27661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.504745 27661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:57.504787 27661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.513633 27661 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:33093
I20260811 14:58:57.513659 27963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:33093 every 8 connection(s)
I20260811 14:58:57.514634 27661 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:58:57.519534 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 27661
I20260811 14:58:57.520089 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:40033
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:43465
--webserver_port=34505
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:58:57.528759 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.516695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:37563 (local address 127.11.225.126:43465)
0811 14:58:57.517205 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.517262 (+ 57us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.517800 (+ 538us) server_negotiation.cc:407] Connection header received
0811 14:58:57.518808 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.518820 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.519104 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.519366 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.520949 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.522288 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.523429 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.524210 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.524395 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.528092 (+ 3697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:37563: BlockingRecv error: recv got EOF from 127.11.225.65:37563 (error 108)
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":126,"threads_started":1}
I20260811 14:58:57.528919 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.516852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:37563)
0811 14:58:57.517612 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.517664 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.518449 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.519512 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.519523 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.520068 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.520759 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.520781 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.522451 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.522455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.523291 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.523300 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.524375 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.524378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.524509 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.525121 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.525137 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.527900 (+ 2763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":143,"threads_started":1}
W20260811 14:58:57.529536 27964 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:43465 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.225.126:43465: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.534960 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.530013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:44445)
0811 14:58:57.530143 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.530160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.530235 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.530453 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.530456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.530622 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.530715 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.530720 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.531453 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.531457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.532011 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.532020 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.532463 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.532466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.532565 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.533029 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.533040 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.534825 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 14:58:57.535050 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.530119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:44445 (local address 127.11.225.126:43465)
0811 14:58:57.530244 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.530248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.530263 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:57.530305 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.530307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.530354 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.530441 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.530873 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.531346 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.532135 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.532351 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.532459 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.534940 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:44445: BlockingRecv error: recv got EOF from 127.11.225.65:44445 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.540474 27969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.535640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:51205)
0811 14:58:57.535807 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.535827 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.535884 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.536109 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.536111 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.536224 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.536286 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.536290 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.537264 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.537266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.537737 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.537745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.538340 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.538342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.538396 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.538844 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.538855 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.540395 (+ 1540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108}
W20260811 14:58:57.540683 27964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:58:57.540843 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.535751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51205 (local address 127.11.225.126:43465)
0811 14:58:57.535866 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.535870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.535883 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:57.535958 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.535961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.536000 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.536079 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.536385 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.537119 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.537862 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.538220 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.538336 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.540543 (+ 2207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:51205: BlockingRecv error: recv got EOF from 127.11.225.65:51205 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 14:58:57.638029 27972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:57.638278 27972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:57.638320 27972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:57.642225 27972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:57.642278 27972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:57.642334 27972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:58:57.647394 27972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.66.keytab
--principal=oryx/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:40033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=34505
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:57.648367 27972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:57.649384 27972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:57.659601 27993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.659621 27981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:57.659636 27972 server_base.cc:1034] running on GCE node
W20260811 14:58:57.659616 27980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:57.660414 27972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:57.661099 27972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:57.662292 27972 hybrid_clock.cc:648] HybridClock initialized: now 1786460337662268 us; error 33 us; skew 500 ppm
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460337, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:57.665483 27972 init.cc:377] Logged in from keytab as oryx/127.11.225.66@KRBTEST.COM (short username oryx)
I20260811 14:58:57.666364 27972 webserver.cc:460] Webserver started at http://127.11.225.66:34505/ using document root <none> and password file <none>
I20260811 14:58:57.666939 27972 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:57.667023 27972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:57.670976 27972 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:57.673079 28005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.674404 27972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:58:57.674546 27972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "356cae31c47747cfb1defedad04c179e"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "8d13629d42869612efb2d30a3afe493b"
server_key_iv: "ca76889cf7cc89763868b52be94080df"
server_key_version: "encryptionkey@0"
I20260811 14:58:57.675086 27972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:57.699201 27972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:57.702620 27972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:57.702826 27972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:57.703469 27972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:57.704319 27972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:57.704391 27972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.704463 27972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:57.704512 27972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.713663 27972 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:40033
I20260811 14:58:57.713698 28225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:40033 every 8 connection(s)
I20260811 14:58:57.714637 27972 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:58:57.718315 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 27972
I20260811 14:58:57.718869 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:45873
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:43465
--webserver_port=46423
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:58:57.727151 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.716382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:38847 (local address 127.11.225.126:43465)
0811 14:58:57.716516 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.716520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.717574 (+ 1054us) server_negotiation.cc:407] Connection header received
0811 14:58:57.718743 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.718745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.718798 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.718864 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.720465 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.720980 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.722721 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.722931 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.723008 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.726960 (+ 3952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:38847: BlockingRecv error: recv got EOF from 127.11.225.66:38847 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:58:57.727550 28232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.716741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:38847)
0811 14:58:57.717431 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.717471 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.718480 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.719104 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.719115 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.719637 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.720300 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.720322 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.721126 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.721131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.722599 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.722615 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.723097 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.723104 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.723338 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.723948 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.723978 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.726757 (+ 2779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":115,"threads_started":1}
W20260811 14:58:57.728142 28230 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:43465 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.225.126:43465: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.733574 28232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.728569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:39641)
0811 14:58:57.728675 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.728692 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.728765 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.729028 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.729031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.729195 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.729356 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.729361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.730068 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.730071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.730639 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.730647 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.731091 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.731095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.731186 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.731648 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.731666 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.733429 (+ 1763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 14:58:57.733686 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.728694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:39641 (local address 127.11.225.126:43465)
0811 14:58:57.728831 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.728837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.728852 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:57.728890 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.728891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.728924 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.729035 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.729466 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.729941 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.730766 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.730976 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.731090 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.733547 (+ 2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:39641: BlockingRecv error: recv got EOF from 127.11.225.66:39641 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.739310 28232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.734186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:41695)
0811 14:58:57.734377 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.734391 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.734463 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.734686 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.734689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.734843 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.734905 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.734910 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.735628 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.735633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.736147 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.736154 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.736635 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.736639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.736716 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.737179 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.737195 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.739177 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 14:58:57.739471 28230 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:58:57.739395 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.734297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41695 (local address 127.11.225.126:43465)
0811 14:58:57.734444 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.734448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.734461 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:57.734544 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.734547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.734584 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.734671 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.735019 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.735523 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.736289 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.736528 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.736630 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.739285 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:41695: BlockingRecv error: recv got EOF from 127.11.225.66:41695 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 14:58:57.843518 28234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:58:57.843940 28234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:58:57.844063 28234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:58:57.848479 28234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:58:57.848573 28234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:58:57.848662 28234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:58:57.854241 28234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/krb5kdc/oryx_127.11.225.67.keytab
--principal=oryx/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:45873
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=46423
--tserver_master_addrs=127.11.225.126:43465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:58:57.855455 28234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:58:57.856666 28234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:58:57.867177 28246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.867198 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:58:57.867197 28258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:58:57.867697 28234 server_base.cc:1034] running on GCE node
I20260811 14:58:57.868137 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:58:57.868733 28234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:58:57.869908 28234 hybrid_clock.cc:648] HybridClock initialized: now 1786460337869871 us; error 47 us; skew 500 ppm
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460337, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:58:57.872787 28234 init.cc:377] Logged in from keytab as oryx/127.11.225.67@KRBTEST.COM (short username oryx)
I20260811 14:58:57.873783 28234 webserver.cc:460] Webserver started at http://127.11.225.67:46423/ using document root <none> and password file <none>
I20260811 14:58:57.874372 28234 fs_manager.cc:359] Metadata directory not provided
I20260811 14:58:57.874449 28234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:58:57.878618 28234 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:58:57.880882 28273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.882218 28234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 14:58:57.882355 28234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "94cc869e45ae47bdb0b84cae03f72b55"
format_stamp: "Formatted at 2026-08-11 14:58:56 on dist-test-slave-8hhm"
server_key: "9b78deef8b70dd87644b7971a2aebc66"
server_key_iv: "251bfe3c43564e418c811d01afad7c3f"
server_key_version: "encryptionkey@0"
I20260811 14:58:57.882899 28234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:58:57.905133 28234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:58:57.908437 28234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:58:57.908658 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:58:57.909334 28234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:58:57.910202 28234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:58:57.910249 28234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.910290 28234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:58:57.910344 28234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:58:57.920110 28234 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:45873
I20260811 14:58:57.920130 28492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:45873 every 8 connection(s)
I20260811 14:58:57.921159 28234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:58:57.928045 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 28234
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 14:58:57.932750 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.923102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:51657 (local address 127.11.225.126:43465)
0811 14:58:57.923246 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.923250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.924317 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 14:58:57.925298 (+ 981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.925302 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.925365 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.925445 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.926619 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.927143 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.928590 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.928823 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.928939 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.932623 (+ 3684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:51657: BlockingRecv error: recv got EOF from 127.11.225.67:51657 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 14:58:57.933552 28497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.923507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:51657)
0811 14:58:57.924166 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.924206 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.925030 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.925623 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.925629 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.925976 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.926462 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.926474 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.927276 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.927284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.928461 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.928471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.928983 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.928987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.929204 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.929903 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.929920 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.932497 (+ 2577us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":121,"threads_started":1}
W20260811 14:58:57.934059 28495 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:43465 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.225.126:43465: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.939464 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.929127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.11.225.126:43465)
0811 14:58:57.929429 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.929434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.929470 (+ 36us) server_negotiation.cc:407] Connection header received
0811 14:58:57.929517 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.929523 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.929572 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.929677 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.930532 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.931220 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.932205 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.932461 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.932579 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.934694 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:58:57.934701 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:58:57.934721 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:58:57.934758 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:58:57.936916 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:57.937485 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:57.937491 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:57.937495 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:57.937630 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:58:57.938009 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:58:57.938012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:58:57.938015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:58:57.938483 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:58:57.938719 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 14:58:57.939030 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 14:58:57.939300 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":130,"threads_started":1}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.940260 28497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.934576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:36085)
0811 14:58:57.934710 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.934724 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.934800 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.935062 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.935069 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.935227 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.935366 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.935376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.936261 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.936265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.937125 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.937134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.937753 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.937756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.937842 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.938277 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.938290 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.940176 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 14:58:57.940480 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.934638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:36085 (local address 127.11.225.126:43465)
0811 14:58:57.934757 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.934760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.934774 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:58:57.934892 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.934894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.934928 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.935003 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.935495 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.936144 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.937303 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.937629 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.937753 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.940346 (+ 2593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:36085: BlockingRecv error: recv got EOF from 127.11.225.67:36085 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:57 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:57.945636 28497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:57.940802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:37825)
0811 14:58:57.940899 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:57.940914 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:57.940981 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:57.941271 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:57.941274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:57.941450 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:57.941535 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.941542 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.942339 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.942342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.942850 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:57.942858 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.943305 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.943309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:57.943387 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.943763 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:57.943773 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:57.945496 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 14:58:57.945816 28495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 14:58:57.945726 27968 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:57.940876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:37825 (local address 127.11.225.126:43465)
0811 14:58:57.941006 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:57.941011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:57.941026 (+ 15us) server_negotiation.cc:407] Connection header received
0811 14:58:57.941065 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:57.941068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:57.941109 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:57.941228 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:57.941717 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.942225 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.942971 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:57.943196 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:57.943302 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:57.945611 (+ 2309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:37825: BlockingRecv error: recv got EOF from 127.11.225.67:37825 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:58.550792 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:58.541390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:54115)
0811 14:58:58.541675 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:58.541689 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:58.541779 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:58.542171 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:58.542173 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:58.542359 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:58.542500 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.542506 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.543319 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.543322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.543899 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.543907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.544384 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.544387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.544464 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.548475 (+ 4011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:58.548490 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:58.550674 (+ 2184us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":88,"threads_started":1}
W20260811 14:58:58.550947 28502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:58.541449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:54115 (local address 127.11.225.126:43465)
0811 14:58:58.541735 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:58.541739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:58.541752 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:58:58.541922 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:58.541925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:58.542032 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:58.542123 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:58.542638 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.543205 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.544015 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.544271 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.544352 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.550810 (+ 6458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:54115: BlockingRecv error: recv got EOF from 127.11.225.65:54115 (error 108)
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":102,"threads_started":1}
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:58.746297 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:58.740195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:52111)
0811 14:58:58.740563 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:58.740579 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:58.740699 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:58.740958 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:58.740960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:58.741170 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:58.741343 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.741350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.742105 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.742108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.742735 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.742743 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.743199 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.743202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.743280 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.743915 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:58.743927 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:58.746107 (+ 2180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":116,"threads_started":1}
W20260811 14:58:58.746408 28502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:58.740251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52111 (local address 127.11.225.126:43465)
0811 14:58:58.740401 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:58.740423 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:58.740700 (+ 277us) server_negotiation.cc:407] Connection header received
0811 14:58:58.740787 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:58.740790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:58.740841 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:58.740907 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:58.741472 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.742000 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.742853 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.743082 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.743166 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.746274 (+ 3108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:52111: BlockingRecv error: recv got EOF from 127.11.225.66:52111 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:58 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:58.952150 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:58.946448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:59793)
0811 14:58:58.946759 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:58.946773 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:58.946871 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:58.947159 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:58.947162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:58.947344 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:58.947441 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.947446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.948213 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.948216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.948786 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:58.948793 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.949341 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.949344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:58.949407 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.949965 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:58.949976 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:58.952027 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":133,"threads_started":1}
W20260811 14:58:58.952221 28502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:58.946577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:59793 (local address 127.11.225.126:43465)
0811 14:58:58.946721 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:58.946725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:58.946845 (+ 120us) server_negotiation.cc:407] Connection header received
0811 14:58:58.946951 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:58.946953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:58.947000 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:58.947087 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:58.947563 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.948107 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.948906 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:58.949162 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:58.949280 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:58.952128 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:59793: BlockingRecv error: recv got EOF from 127.11.225.67:59793 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:59.557114 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:59.551802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:41665)
0811 14:58:59.552128 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:59.552142 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:59.552243 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:59.552506 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:59.552508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:59.552700 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:59.552800 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.552804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.553583 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.553586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.554146 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.554154 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.554554 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.554557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.554620 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.555093 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:59.555104 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:59.556972 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":94,"threads_started":1}
W20260811 14:58:59.557348 28516 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:59.551860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:41665 (local address 127.11.225.126:43465)
0811 14:58:59.552161 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:59.552165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:59.552197 (+ 32us) server_negotiation.cc:407] Connection header received
0811 14:58:59.552332 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:59.552334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:59.552380 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:59.552459 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:59.552912 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.553486 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.554245 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.554459 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.554531 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.557171 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:41665: BlockingRecv error: recv got EOF from 127.11.225.65:41665 (error 108)
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":65,"threads_started":1}
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:59.752766 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:59.747192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:36375)
0811 14:58:59.747498 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:59.747514 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:59.747625 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:59.747847 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:59.747849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:59.748077 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:59.748178 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.748184 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.748909 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.748912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.749524 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.749533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.749994 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.750032 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.750106 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.750623 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:59.750635 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:59.752643 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":114,"threads_started":1}
W20260811 14:58:59.752940 28516 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:59.747321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:36375 (local address 127.11.225.126:43465)
0811 14:58:59.747482 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:59.747486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:59.747576 (+ 90us) server_negotiation.cc:407] Connection header received
0811 14:58:59.747692 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:59.747694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:59.747737 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:59.747809 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:59.748293 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.748812 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.749640 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.749861 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.749941 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.752777 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:36375: BlockingRecv error: recv got EOF from 127.11.225.66:36375 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:58:59 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:58:59.959021 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:58:59.952952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:51023)
0811 14:58:59.953299 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 14:58:59.953313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:58:59.953412 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:58:59.953655 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:58:59.953657 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:58:59.953853 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:58:59.953950 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.953954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.954737 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.954741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.955348 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:58:59.955357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.956075 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.956078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:58:59.956139 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.956665 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:58:59.956679 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:58:59.958827 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":116,"threads_started":1}
W20260811 14:58:59.959127 28516 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:58:59.953128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:51023 (local address 127.11.225.126:43465)
0811 14:58:59.953291 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:58:59.953294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:58:59.953384 (+ 90us) server_negotiation.cc:407] Connection header received
0811 14:58:59.953501 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:58:59.953504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:58:59.953548 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:58:59.953615 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:58:59.954090 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.954622 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.955466 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:58:59.955928 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:58:59.956062 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:58:59.958968 (+ 2906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:51023: BlockingRecv error: recv got EOF from 127.11.225.67:51023 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:00.564121 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:00.558088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:37649)
0811 14:59:00.558423 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:00.558437 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:00.558534 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:00.558815 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:00.558818 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:00.559073 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:00.559170 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.559176 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.559985 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.559990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.560565 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.560573 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.561050 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.561053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.561142 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.561716 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:00.561729 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:00.563987 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":96,"threads_started":1}
W20260811 14:59:00.564288 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:00.558245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:37649 (local address 127.11.225.126:43465)
0811 14:59:00.558490 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:00.558493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:00.558507 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:59:00.558629 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:00.558632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:00.558677 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:00.558790 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:00.559309 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.559860 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.560691 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.560929 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.561044 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.564122 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:37649: BlockingRecv error: recv got EOF from 127.11.225.65:37649 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":60,"threads_started":1}
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:00.759598 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:00.753783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:35957)
0811 14:59:00.754116 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:00.754129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:00.754228 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:00.754477 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:00.754479 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:00.754668 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:00.754768 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.754773 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.755591 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.755594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.756167 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.756175 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.756700 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.756704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.756801 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.757487 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:00.757502 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:00.759472 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":107,"threads_started":1}
W20260811 14:59:00.759723 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:00.753904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:35957 (local address 127.11.225.126:43465)
0811 14:59:00.754105 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:00.754109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:00.754197 (+ 88us) server_negotiation.cc:407] Connection header received
0811 14:59:00.754310 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:00.754312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:00.754358 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:00.754437 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:00.754883 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.755462 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.756287 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.756570 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.756672 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.759607 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:35957: BlockingRecv error: recv got EOF from 127.11.225.66:35957 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:00 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:00.966140 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:00.959867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:51353)
0811 14:59:00.960151 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:00.960164 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:00.960267 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:00.960510 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:00.960512 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:00.960701 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:00.960799 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.960804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.961712 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.961715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.962409 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:00.962420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.963006 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.963010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:00.963080 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.963733 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:00.963747 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:00.965923 (+ 2176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
W20260811 14:59:00.966213 28521 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:00.959955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:51353 (local address 127.11.225.126:43465)
0811 14:59:00.960108 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:00.960112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:00.960218 (+ 106us) server_negotiation.cc:407] Connection header received
0811 14:59:00.960350 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:00.960352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:00.960398 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:00.960463 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:00.960905 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.961570 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.962520 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:00.962861 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:00.962978 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:00.966079 (+ 3101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:51353: BlockingRecv error: recv got EOF from 127.11.225.67:51353 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:01.570520 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:01.564892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:46559)
0811 14:59:01.565296 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:01.565311 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:01.565413 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:01.565699 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:01.565701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:01.565885 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:01.565983 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.565988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.566739 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.566742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.567348 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.567357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.567791 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.567793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.567887 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.568457 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:01.568469 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:01.570389 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":81,"threads_started":1}
W20260811 14:59:01.570715 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:01.564940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:46559 (local address 127.11.225.126:43465)
0811 14:59:01.565289 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:01.565293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:01.565390 (+ 97us) server_negotiation.cc:407] Connection header received
0811 14:59:01.565496 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:01.565498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:01.565562 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:01.565640 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:01.566099 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.566637 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.567459 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.567691 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.567769 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.570563 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:46559: BlockingRecv error: recv got EOF from 127.11.225.65:46559 (error 108)
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":127,"threads_started":1}
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:01.766520 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:01.760421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:41995)
0811 14:59:01.760743 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:01.760769 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:01.760911 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:01.761191 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:01.761194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:01.761439 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:01.761539 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.761545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.762552 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.762556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.763248 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.763257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.763801 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.763805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.763892 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.764451 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:01.764463 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:01.766400 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":97,"threads_started":1}
W20260811 14:59:01.766743 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:01.760495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41995 (local address 127.11.225.126:43465)
0811 14:59:01.760705 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:01.760710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:01.760851 (+ 141us) server_negotiation.cc:407] Connection header received
0811 14:59:01.761015 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:01.761019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:01.761074 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:01.761164 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:01.761656 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.762413 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.763387 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.763681 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.763784 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.766544 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:41995: BlockingRecv error: recv got EOF from 127.11.225.66:41995 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:01 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:01.972790 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:01.967204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:51077)
0811 14:59:01.967476 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:01.967490 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:01.967598 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:01.967836 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:01.967838 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:01.968027 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:01.968126 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.968132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.969053 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.969056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.969719 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:01.969730 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.970226 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.970229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:01.970290 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.970820 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:01.970832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:01.972673 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":87,"threads_started":1}
W20260811 14:59:01.973100 28526 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:01.967320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:51077 (local address 127.11.225.126:43465)
0811 14:59:01.967470 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:01.967474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:01.967599 (+ 125us) server_negotiation.cc:407] Connection header received
0811 14:59:01.967668 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:01.967671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:01.967723 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:01.967802 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:01.968298 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.968917 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.969840 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:01.970120 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:01.970212 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:01.972968 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:51077: BlockingRecv error: recv got EOF from 127.11.225.67:51077 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:02.577523 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:02.571446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:53581)
0811 14:59:02.571821 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:02.571836 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:02.571932 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:02.572219 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:02.572221 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:02.572417 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:02.572524 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.572529 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.573407 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.573410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.574016 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.574028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.574544 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.574547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.574614 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.575196 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:02.575207 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:02.577344 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":103,"threads_started":1}
W20260811 14:59:02.577759 28536 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:02.571576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53581 (local address 127.11.225.126:43465)
0811 14:59:02.571893 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:02.571897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:02.571913 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:59:02.572041 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:02.572044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:02.572090 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:02.572178 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:02.572645 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.573289 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.574155 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.574402 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.574495 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.577626 (+ 3131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:53581: BlockingRecv error: recv got EOF from 127.11.225.65:53581 (error 108)
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":107,"threads_started":1}
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:02.773191 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:02.767328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:36497)
0811 14:59:02.767663 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:02.767679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:02.767816 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:02.768132 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:02.768136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:02.768359 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:02.768452 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.768458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.769333 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.769337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.769923 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.769932 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.770430 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.770434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.770518 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.771043 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:02.771055 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:02.773030 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
W20260811 14:59:02.773340 28536 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:02.767509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:36497 (local address 127.11.225.126:43465)
0811 14:59:02.767665 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:02.767671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:02.767758 (+ 87us) server_negotiation.cc:407] Connection header received
0811 14:59:02.767921 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:02.767924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:02.767980 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:02.768108 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:02.768594 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.769169 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.770056 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.770296 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.770421 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.773197 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:36497: BlockingRecv error: recv got EOF from 127.11.225.66:36497 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:02 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:02.979736 28540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:02.973686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:42281)
0811 14:59:02.974011 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:02.974025 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:02.974144 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:02.974403 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:02.974406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:02.974609 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:02.974707 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.974712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.975488 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.975491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.976086 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:02.976093 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.976765 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.976768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:02.976854 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.977453 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:02.977465 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:02.979565 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":98,"threads_started":1}
W20260811 14:59:02.979792 28536 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:02.973764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:42281 (local address 127.11.225.126:43465)
0811 14:59:02.973924 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:02.973930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:02.974121 (+ 191us) server_negotiation.cc:407] Connection header received
0811 14:59:02.974245 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:02.974247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:02.974295 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:02.974363 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:02.974837 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.975371 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.976351 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:02.976637 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:02.976757 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:02.979685 (+ 2928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:42281: BlockingRecv error: recv got EOF from 127.11.225.67:42281 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:03.587388 28541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:03.578630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:42573)
0811 14:59:03.578926 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:03.578943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:03.579070 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:03.579318 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:03.579320 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:03.579511 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:03.579628 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.579633 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.580439 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.580443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.580994 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.581002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.581474 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.581476 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.581545 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.584886 (+ 3341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:03.584898 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:03.587266 (+ 2368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":93,"threads_started":1}
W20260811 14:59:03.587656 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:03.578648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:42573 (local address 127.11.225.126:43465)
0811 14:59:03.578900 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:03.578903 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:03.579028 (+ 125us) server_negotiation.cc:407] Connection header received
0811 14:59:03.579140 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:03.579142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:03.579189 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:03.579266 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:03.579735 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.580313 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.581131 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.581375 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.581451 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.587401 (+ 5950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:42573: BlockingRecv error: recv got EOF from 127.11.225.65:42573 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":88,"threads_started":1}
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:03.779943 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:03.774118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:60071)
0811 14:59:03.774400 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:03.774413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:03.774544 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:03.774830 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:03.774833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:03.775061 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:03.775152 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.775157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.775957 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.775961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.776532 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.776542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.777005 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.777008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.777103 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.777730 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:03.777743 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:03.779766 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":110,"threads_started":1}
W20260811 14:59:03.779987 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:03.774138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:60071 (local address 127.11.225.126:43465)
0811 14:59:03.774287 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:03.774291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:03.774492 (+ 201us) server_negotiation.cc:407] Connection header received
0811 14:59:03.774660 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:03.774664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:03.774719 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:03.774805 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:03.775272 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.775840 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.776658 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.776889 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.776999 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.779886 (+ 2887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:60071: BlockingRecv error: recv got EOF from 127.11.225.66:60071 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:03 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:03.986320 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:03.980517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:38905)
0811 14:59:03.980840 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:03.980854 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:03.980957 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:03.981294 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:03.981297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:03.981556 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:03.981679 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.981688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.982676 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.982680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.983246 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:03.983254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.983698 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.983700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:03.983773 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.984355 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:03.984367 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:03.986191 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":139,"threads_started":1}
W20260811 14:59:03.986471 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:03.980611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:38905 (local address 127.11.225.126:43465)
0811 14:59:03.980757 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:03.980761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:03.980927 (+ 166us) server_negotiation.cc:407] Connection header received
0811 14:59:03.981040 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:03.981042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:03.981091 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:03.981164 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:03.981817 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.982558 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.983350 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:03.983573 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:03.983669 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:03.986345 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:38905: BlockingRecv error: recv got EOF from 127.11.225.67:38905 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:04.594094 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:04.588202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:45189)
0811 14:59:04.588603 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:04.588618 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:04.588733 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:04.589022 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:04.589024 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:04.589244 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:04.589349 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.589355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.590117 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.590120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.590691 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.590700 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.591218 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.591221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.591289 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.591862 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:04.591874 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:04.593879 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":85,"threads_started":1}
W20260811 14:59:04.594122 28548 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:04.588353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:45189 (local address 127.11.225.126:43465)
0811 14:59:04.588616 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:04.588620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:04.588693 (+ 73us) server_negotiation.cc:407] Connection header received
0811 14:59:04.588817 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:04.588819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:04.588865 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:04.588940 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:04.589456 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.589990 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.590829 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.591087 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.591178 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.594004 (+ 2826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:45189: BlockingRecv error: recv got EOF from 127.11.225.65:45189 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:04.787299 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:04.780846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:58837)
0811 14:59:04.781270 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:04.781284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:04.781432 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:04.781735 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:04.781738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:04.781967 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:04.782063 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.782068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.782848 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.782853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.783456 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.783467 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.783946 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.783950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.784049 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.784678 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:04.784689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:04.787126 (+ 2437us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":111,"threads_started":1}
W20260811 14:59:04.787366 28548 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:04.780937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:58837 (local address 127.11.225.126:43465)
0811 14:59:04.781188 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:04.781194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:04.781372 (+ 178us) server_negotiation.cc:407] Connection header received
0811 14:59:04.781545 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:04.781548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:04.781603 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:04.781701 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:04.782193 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.782730 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.783590 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.783824 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.783938 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.787272 (+ 3334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:58837: BlockingRecv error: recv got EOF from 127.11.225.66:58837 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:04 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:04.993189 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:04.987440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:56881)
0811 14:59:04.987790 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:04.987804 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:04.987958 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:04.988310 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:04.988314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:04.988597 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:04.988734 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.988743 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.989691 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.989694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.990249 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:04.990256 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.990679 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.990681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:04.990744 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.991230 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:04.991241 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:04.993069 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
W20260811 14:59:04.993430 28548 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:04.987469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:56881 (local address 127.11.225.126:43465)
0811 14:59:04.987612 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:04.987616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:04.987903 (+ 287us) server_negotiation.cc:407] Connection header received
0811 14:59:04.988078 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:04.988081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:04.988159 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:04.988246 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:04.988872 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.989579 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.990350 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:04.990579 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:04.990659 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:04.993246 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:56881: BlockingRecv error: recv got EOF from 127.11.225.67:56881 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:05.601164 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:05.595231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:33471)
0811 14:59:05.595561 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:05.595575 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:05.595668 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:05.595910 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:05.595912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:05.596103 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:05.596205 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.596210 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.596952 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.596954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.597628 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.597639 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.598123 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.598126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.598197 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.598763 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:05.598778 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:05.601042 (+ 2264us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":114,"threads_started":1}
W20260811 14:59:05.601433 28552 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:05.595418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33471 (local address 127.11.225.126:43465)
0811 14:59:05.595650 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:05.595654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:05.595668 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:59:05.595749 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:05.595751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:05.595793 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:05.595869 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:05.596308 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.596852 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.597737 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.597970 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.598053 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.601135 (+ 3082us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:33471: BlockingRecv error: recv got EOF from 127.11.225.65:33471 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":68,"threads_started":1}
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:05.794576 28554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:05.788224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:38473)
0811 14:59:05.788607 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:05.788622 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:05.788729 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:05.789120 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:05.789124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:05.789443 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:05.789587 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.789599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.790754 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.790757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.791328 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.791336 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.791805 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.791808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.791874 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.792436 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:05.792449 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:05.794398 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":87,"threads_started":1}
W20260811 14:59:05.794678 28552 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:05.788378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:38473 (local address 127.11.225.126:43465)
0811 14:59:05.788595 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:05.788600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:05.788705 (+ 105us) server_negotiation.cc:407] Connection header received
0811 14:59:05.788869 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:05.788872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:05.788921 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:05.789059 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:05.789732 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.790625 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.791449 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.791683 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.791777 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.794562 (+ 2785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:38473: BlockingRecv error: recv got EOF from 127.11.225.66:38473 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:05 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:05.999764 28557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:05.993949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:34883)
0811 14:59:05.994333 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:05.994346 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:05.994446 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:05.994688 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:05.994690 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:05.994904 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:05.995001 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.995006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.995841 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.995844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.996428 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:05.996437 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.996911 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.996914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:05.996976 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.997582 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:05.997594 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:05.999628 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":122,"threads_started":1}
W20260811 14:59:06.000160 28552 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:05.994173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:34883 (local address 127.11.225.126:43465)
0811 14:59:05.994326 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:05.994330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:05.994416 (+ 86us) server_negotiation.cc:407] Connection header received
0811 14:59:05.994524 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:05.994526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:05.994573 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:05.994646 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:05.995150 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.995691 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.996565 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:05.996794 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:05.996895 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:05.999805 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:34883: BlockingRecv error: recv got EOF from 127.11.225.67:34883 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 14:59:06 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:06 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:06.607992 28558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:06.601959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:36109)
0811 14:59:06.602326 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:06.602340 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:06.602442 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:06.602715 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:06.602717 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:06.602903 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:06.603038 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:06.603045 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.603815 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.603818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:06.604399 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:06.604408 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.604969 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.604972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:06.605080 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:06.605725 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:06.605747 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:06.607852 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":103,"threads_started":1}
W20260811 14:59:06.608212 28561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:06.602094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36109 (local address 127.11.225.126:43465)
0811 14:59:06.602361 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:06.602364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:06.602395 (+ 31us) server_negotiation.cc:407] Connection header received
0811 14:59:06.602546 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:06.602548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:06.602595 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:06.602674 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:06.603158 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.603705 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.604557 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.604826 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.604936 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:06.608028 (+ 3092us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:36109: BlockingRecv error: recv got EOF from 127.11.225.65:36109 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":66,"threads_started":1}
Aug 11 14:59:06 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:06 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:06.801972 28563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:06.795397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:39709)
0811 14:59:06.795767 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:06.795790 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:06.795939 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:06.796271 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:06.796274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:06.796498 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:06.796596 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:06.796602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.797478 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.797482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:06.798105 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:06.798114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.798610 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.798614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:06.798700 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:06.799371 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:06.799386 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:06.801784 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":108,"threads_started":1}
W20260811 14:59:06.802021 28561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:06.795539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:39709 (local address 127.11.225.126:43465)
0811 14:59:06.795733 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:06.795738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:06.795872 (+ 134us) server_negotiation.cc:407] Connection header received
0811 14:59:06.796088 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:06.796092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:06.796148 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:06.796242 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:06.796728 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.797364 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.798232 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:06.798478 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:06.798591 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:06.801916 (+ 3325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:39709: BlockingRecv error: recv got EOF from 127.11.225.66:39709 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:07.006747 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:07.000688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:53985)
0811 14:59:07.000980 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:07.001014 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:07.001152 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:07.001518 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:07.001521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:07.001768 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:07.001868 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.001874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.002654 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.002659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.003238 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.003246 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.003730 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.003734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.003823 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.004433 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:07.004445 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:07.006608 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":90,"threads_started":1}
W20260811 14:59:07.006882 28561 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:07.000736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:53985 (local address 127.11.225.126:43465)
0811 14:59:07.000891 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:07.000896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:07.001134 (+ 238us) server_negotiation.cc:407] Connection header received
0811 14:59:07.001292 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:07.001295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:07.001359 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:07.001475 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:07.002005 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.002538 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.003366 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.003604 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.003713 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.006755 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:53985: BlockingRecv error: recv got EOF from 127.11.225.67:53985 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:07.614606 28573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:07.608811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:45203)
0811 14:59:07.609105 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:07.609124 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:07.609227 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:07.609464 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:07.609466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:07.609663 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:07.609763 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.609768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.610523 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.610525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.611096 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.611103 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.611524 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.611527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.611599 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.612180 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:07.612192 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:07.614323 (+ 2131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":109,"threads_started":1}
W20260811 14:59:07.614650 28574 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:07.608899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:45203 (local address 127.11.225.126:43465)
0811 14:59:07.609168 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:07.609172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:07.609185 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:59:07.609308 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:07.609310 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:07.609351 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:07.609420 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:07.609866 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.610426 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.611199 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.611425 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.611504 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.614487 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:45203: BlockingRecv error: recv got EOF from 127.11.225.65:45203 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":110,"threads_started":1}
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:07 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:07.808637 28576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:07.802862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:53651)
0811 14:59:07.803210 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:07.803232 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:07.803374 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:07.803659 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:07.803662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:07.803883 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:07.803975 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.803981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.804834 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.804839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.805417 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:07.805426 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.805895 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.805898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:07.805983 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.806498 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:07.806511 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:07.808459 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":86,"threads_started":1}
W20260811 14:59:07.808714 28574 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:07.802974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:53651 (local address 127.11.225.126:43465)
0811 14:59:07.803180 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:07.803185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:07.803312 (+ 127us) server_negotiation.cc:407] Connection header received
0811 14:59:07.803477 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:07.803480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:07.803541 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:07.803632 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:07.804138 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.804701 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.805546 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:07.805776 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:07.805886 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:07.808605 (+ 2719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:53651: BlockingRecv error: recv got EOF from 127.11.225.66:53651 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:08.013322 28577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:08.007593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:56231)
0811 14:59:08.007927 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:08.007945 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:08.008102 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:08.008389 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:08.008393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:08.008628 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:08.008741 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.008747 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.009574 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.009580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.010159 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.010167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.010628 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.010631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.010730 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.011253 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:08.011264 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:08.013121 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":129,"threads_started":1}
W20260811 14:59:08.013386 28574 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:08.007774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:56231 (local address 127.11.225.126:43465)
0811 14:59:08.007927 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:08.007933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:08.008045 (+ 112us) server_negotiation.cc:407] Connection header received
0811 14:59:08.008212 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:08.008215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:08.008270 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:08.008357 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:08.008866 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.009465 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.010283 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.010512 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.010622 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.013278 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:56231: BlockingRecv error: recv got EOF from 127.11.225.67:56231 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:08.624533 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:08.615455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:46205)
0811 14:59:08.615760 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:08.615773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:08.615864 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:08.616104 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:08.616106 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:08.616289 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:08.616383 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.616388 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.617127 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.617130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.617715 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.617723 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.618226 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.618229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.618298 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.622348 (+ 4050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:08.622360 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:08.624396 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":121,"threads_started":1}
W20260811 14:59:08.624689 28580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:08.615544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:46205 (local address 127.11.225.126:43465)
0811 14:59:08.615809 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:08.615813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:08.615827 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:59:08.615956 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:08.615958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:08.616004 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:08.616092 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:08.616481 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.617023 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.617848 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.618108 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.618198 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.624540 (+ 6342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:46205: BlockingRecv error: recv got EOF from 127.11.225.65:46205 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":69,"threads_started":1}
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:08 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:08.815004 28584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:08.809485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:49415)
0811 14:59:08.809796 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:08.809810 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:08.809909 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:08.810172 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:08.810174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:08.810357 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:08.810465 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.810470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.811220 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.811223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.811796 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:08.811803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.812270 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.812273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:08.812336 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.812917 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:08.812929 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:08.814872 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":136,"threads_started":1}
W20260811 14:59:08.815215 28580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:08.809606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49415 (local address 127.11.225.126:43465)
0811 14:59:08.809748 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:08.809758 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:08.809863 (+ 105us) server_negotiation.cc:407] Connection header received
0811 14:59:08.809974 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:08.809977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:08.810054 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:08.810126 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:08.810598 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.811121 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.811902 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:08.812161 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:08.812244 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:08.815075 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:49415: BlockingRecv error: recv got EOF from 127.11.225.66:49415 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:09.019933 28585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:09.014293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:55205)
0811 14:59:09.014619 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:09.014632 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:09.014780 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:09.015144 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:09.015147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:09.015402 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:09.015547 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.015554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.016348 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.016350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.016888 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.016895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.017352 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.017361 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.017423 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.017928 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:09.017938 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:09.019813 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":102,"threads_started":1}
W20260811 14:59:09.020095 28580 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:09.014374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:55205 (local address 127.11.225.126:43465)
0811 14:59:09.014540 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:09.014545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:09.014731 (+ 186us) server_negotiation.cc:407] Connection header received
0811 14:59:09.014895 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:09.014898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:09.014971 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:09.015068 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:09.015688 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.016245 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.016991 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.017248 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.017324 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.019954 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:55205: BlockingRecv error: recv got EOF from 127.11.225.67:55205 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:09.630985 28587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:09.625523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:44605)
0811 14:59:09.625823 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:09.625836 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:09.625939 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:09.626223 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:09.626225 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:09.626404 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:09.626498 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.626503 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.627258 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.627260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.627801 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.627808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.628278 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.628281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.628342 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.628858 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:09.628869 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:09.630814 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":109,"threads_started":1}
W20260811 14:59:09.631081 28591 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:09.625732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:44605 (local address 127.11.225.126:43465)
0811 14:59:09.625988 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:09.625993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:09.626009 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:59:09.626049 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:09.626051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:09.626095 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:09.626182 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:09.626607 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.627164 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.627903 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.628161 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.628256 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.630954 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:44605: BlockingRecv error: recv got EOF from 127.11.225.65:44605 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":100,"threads_started":1}
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:09 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:09.821519 28595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:09.815923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:50897)
0811 14:59:09.816267 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:09.816283 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:09.816445 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:09.816724 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:09.816727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:09.816947 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:09.817044 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.817051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.817868 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.817872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.818433 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:09.818440 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.818912 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.818916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:09.819002 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.819498 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:09.819509 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:09.821344 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":123,"threads_started":1}
W20260811 14:59:09.821587 28591 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:09.816015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:50897 (local address 127.11.225.126:43465)
0811 14:59:09.816238 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:09.816243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:09.816379 (+ 136us) server_negotiation.cc:407] Connection header received
0811 14:59:09.816551 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:09.816555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:09.816613 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:09.816700 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:09.817174 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.817753 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.818559 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:09.818791 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:09.818905 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:09.821479 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:50897: BlockingRecv error: recv got EOF from 127.11.225.66:50897 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:10.026667 28596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:10.020909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:37849)
0811 14:59:10.021294 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:10.021308 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:10.021456 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:10.021757 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:10.021760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:10.021980 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:10.022103 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.022109 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.022882 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.022887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.023454 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.023461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.023952 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.023955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.024056 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.024649 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:10.024660 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:10.026549 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":145,"threads_started":1}
W20260811 14:59:10.026865 28591 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:10.020983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:37849 (local address 127.11.225.126:43465)
0811 14:59:10.021199 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:10.021203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:10.021392 (+ 189us) server_negotiation.cc:407] Connection header received
0811 14:59:10.021579 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:10.021583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:10.021640 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:10.021731 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:10.022231 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.022769 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.023586 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.023829 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.023936 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.026722 (+ 2786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:37849: BlockingRecv error: recv got EOF from 127.11.225.67:37849 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:10.637816 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:10.631996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:57215)
0811 14:59:10.632301 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:10.632314 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:10.632412 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:10.632718 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:10.632721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:10.632919 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:10.633046 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.633053 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.633823 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.633825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.634437 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.634446 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.634882 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.634885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.634967 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.635512 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:10.635534 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:10.637626 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":117,"threads_started":1}
W20260811 14:59:10.637931 28600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:10.632089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:57215 (local address 127.11.225.126:43465)
0811 14:59:10.632330 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:10.632334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:10.632369 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:59:10.632498 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:10.632500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:10.632550 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:10.632634 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:10.633175 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.633724 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.634556 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.634776 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.634854 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.637763 (+ 2909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:57215: BlockingRecv error: recv got EOF from 127.11.225.65:57215 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:10 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:10.828281 28601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:10.822506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:53115)
0811 14:59:10.822812 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:10.822826 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:10.822923 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:10.823240 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:10.823243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:10.823446 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:10.823555 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.823561 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.824350 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.824352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.824942 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:10.824950 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.825397 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.825400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:10.825463 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.826264 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:10.826277 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:10.828162 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":113,"threads_started":1}
W20260811 14:59:10.828490 28600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:10.822665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:53115 (local address 127.11.225.126:43465)
0811 14:59:10.822841 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:10.822845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:10.822874 (+ 29us) server_negotiation.cc:407] Connection header received
0811 14:59:10.823009 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:10.823012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:10.823085 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:10.823160 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:10.823665 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.824235 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.825064 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:10.825301 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:10.825377 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:10.828348 (+ 2971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:53115: BlockingRecv error: recv got EOF from 127.11.225.66:53115 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:11.037794 28609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:11.027435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:36377)
0811 14:59:11.027737 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:11.027750 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:11.027848 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:11.028056 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:11.028058 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:11.028245 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:11.028339 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.028344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.029114 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.029118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.029769 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.029780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.030223 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.030226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.030289 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.035608 (+ 5319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:11.035621 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:11.037602 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":123,"threads_started":1}
W20260811 14:59:11.037837 28600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:11.027473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:36377 (local address 127.11.225.126:43465)
0811 14:59:11.027709 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:11.027713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:11.027818 (+ 105us) server_negotiation.cc:407] Connection header received
0811 14:59:11.027926 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:11.027928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:11.027974 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:11.028045 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:11.028434 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.028939 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.029888 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.030117 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.030197 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.037727 (+ 7530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:36377: BlockingRecv error: recv got EOF from 127.11.225.67:36377 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:11.644395 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:11.638718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:44509)
0811 14:59:11.639058 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:11.639073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:11.639171 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:11.639416 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:11.639418 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:11.639616 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:11.639715 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.639720 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.640458 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.640460 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.641011 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.641018 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.641510 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.641513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.641624 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.642233 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:11.642247 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:11.644278 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":97,"threads_started":1}
W20260811 14:59:11.644640 28612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:11.638854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:44509 (local address 127.11.225.126:43465)
0811 14:59:11.639195 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:11.639199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:11.639213 (+ 14us) server_negotiation.cc:407] Connection header received
0811 14:59:11.639250 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:11.639252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:11.639293 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:11.639371 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:11.639820 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.640363 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.641112 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.641376 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.641495 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.644463 (+ 2968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:44509: BlockingRecv error: recv got EOF from 127.11.225.65:44509 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":95,"threads_started":1}
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:11 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:11.834590 28615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:11.829058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:41691)
0811 14:59:11.829361 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:11.829375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:11.829502 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:11.829741 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:11.829743 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:11.829935 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:11.830034 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.830040 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.830876 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.830878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.831434 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:11.831442 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.831878 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.831881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:11.831942 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.832434 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:11.832446 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:11.834449 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":103,"threads_started":1}
W20260811 14:59:11.834733 28612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:11.829188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:41691 (local address 127.11.225.126:43465)
0811 14:59:11.829358 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:11.829362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:11.829463 (+ 101us) server_negotiation.cc:407] Connection header received
0811 14:59:11.829583 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:11.829585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:11.829632 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:11.829699 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:11.830136 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.830766 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.831543 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:11.831778 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:11.831855 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:11.834585 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:41691: BlockingRecv error: recv got EOF from 127.11.225.66:41691 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.67@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:12.044804 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:12.038592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.67:42317)
0811 14:59:12.038925 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:12.038939 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:12.039120 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:12.039419 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:12.039423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:12.039651 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:12.039746 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.039752 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.040691 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.040696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.041456 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.041466 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.041938 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.041941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.042036 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.042602 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:12.042616 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:12.044670 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
W20260811 14:59:12.044986 28612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:12.038663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:42317 (local address 127.11.225.126:43465)
0811 14:59:12.038867 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:12.038872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:12.039063 (+ 191us) server_negotiation.cc:407] Connection header received
0811 14:59:12.039245 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:12.039248 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:12.039302 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:12.039391 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:12.039874 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.040583 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.041584 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.041815 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.041931 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.044846 (+ 2915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.67:42317: BlockingRecv error: recv got EOF from 127.11.225.67:42317 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.65@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:12.651476 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:12.645331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.65:41769)
0811 14:59:12.645617 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:12.645630 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:12.645717 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:12.646066 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:12.646069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:12.646264 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:12.646365 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.646371 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.647219 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.647222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.647859 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.647868 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.648364 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.648367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.648440 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.648977 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:12.648990 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:12.651354 (+ 2364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":100,"threads_started":1}
W20260811 14:59:12.651666 28625 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:12.645535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:41769 (local address 127.11.225.126:43465)
0811 14:59:12.645791 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:12.645795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:12.645808 (+ 13us) server_negotiation.cc:407] Connection header received
0811 14:59:12.645845 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:12.645847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:12.645890 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:12.645980 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:12.646518 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.647070 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.647993 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.648248 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.648333 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.651512 (+ 3179us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.65:41769: BlockingRecv error: recv got EOF from 127.11.225.65:41769 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":95,"threads_started":1}
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 14:59:12 dist-test-slave-8hhm krb5kdc[26562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.225.66@KRBTEST.COM for oryx/127.11.225.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 14:59:12.841308 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:12.835555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43465 (local address 127.11.225.66:52231)
0811 14:59:12.835826 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:12.835839 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:12.835934 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:12.836218 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:12.836220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:12.836421 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:12.836521 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.836526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.837349 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.837352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.837913 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:12.837922 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.838422 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.838424 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:12.838496 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.839051 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:12.839063 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:12.841120 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.225.126:43465: Server oryx/127.11.225.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":94,"threads_started":1}
W20260811 14:59:12.841449 28625 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:12.835616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52231 (local address 127.11.225.126:43465)
0811 14:59:12.835756 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:12.835760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:12.835909 (+ 149us) server_negotiation.cc:407] Connection header received
0811 14:59:12.836054 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:12.836056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:12.836100 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:12.836169 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:12.836628 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.837177 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.838097 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:12.838315 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:12.838392 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:12.841327 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.225.66:52231: BlockingRecv error: recv got EOF from 127.11.225.66:52231 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 14:59:12.929651 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 27661
I20260811 14:59:12.952549 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 27972
I20260811 14:59:12.975580 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 28234
I20260811 14:59:12.991782 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 27532
2026-08-11T14:59:13Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18389 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T14:59:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:59:13Z Disabled control of system clock
I20260811 14:59:13.034359 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33735
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 14:59:13.149529 28634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:13.149791 28634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:13.149827 28634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:13.153775 28634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:59:13.153829 28634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:13.153844 28634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:13.153862 28634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:59:13.153877 28634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:59:13.158495 28634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:13.159564 28634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:13.160988 28634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:13.170105 28642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.170115 28645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.170159 28634 server_base.cc:1034] running on GCE node
W20260811 14:59:13.170101 28643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.170939 28634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:13.172084 28634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:13.173295 28634 hybrid_clock.cc:648] HybridClock initialized: now 1786460353173253 us; error 44 us; skew 500 ppm
I20260811 14:59:13.175091 28634 webserver.cc:460] Webserver started at http://127.11.225.126:46713/ using document root <none> and password file <none>
I20260811 14:59:13.175688 28634 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:13.175787 28634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:13.176021 28634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:13.178158 28634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "6484b5a5d3734016845b4be338591a61"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "0c994fbbf9ba922249905a695b8d51c5"
server_key_iv: "3ac2829dee30a192b8cd2566da5ae6d2"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.178740 28634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "6484b5a5d3734016845b4be338591a61"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "0c994fbbf9ba922249905a695b8d51c5"
server_key_iv: "3ac2829dee30a192b8cd2566da5ae6d2"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.182420 28634 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:59:13.184811 28655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.186092 28634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:59:13.186266 28634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "6484b5a5d3734016845b4be338591a61"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "0c994fbbf9ba922249905a695b8d51c5"
server_key_iv: "3ac2829dee30a192b8cd2566da5ae6d2"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.186385 28634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:13.209389 28634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:13.210068 28634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:13.210282 28634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:13.217649 28634 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:33735
I20260811 14:59:13.217661 28740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:33735 every 8 connection(s)
I20260811 14:59:13.218612 28634 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:59:13.220794 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 28634
I20260811 14:59:13.220916 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:59:13.221309 12165 external_mini_cluster.cc:1428] Setting key 26b36591d390b80863ba704371a77bef
I20260811 14:59:13.222407 28746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:13.228364 28746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61: Bootstrap starting.
I20260811 14:59:13.230775 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.222796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38890 (local address 127.11.225.126:33735)
0811 14:59:13.223466 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:13.223481 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:13.223515 (+ 34us) server_negotiation.cc:407] Connection header received
0811 14:59:13.224174 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:13.224192 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:13.224626 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:13.224976 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:13.225428 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.226435 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.227342 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.227864 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.228035 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.228998 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:13.229004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:13.229015 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:13.229473 (+ 458us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:13.229531 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:13.229552 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:13.229667 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:13.229816 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 14:59:13.230072 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":152,"threads_started":1}
I20260811 14:59:13.230801 28746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:13.231753 28746 log.cc:824] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:13.233922 28746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61: No bootstrap required, opened a new log
I20260811 14:59:13.237816 28746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } }
I20260811 14:59:13.238049 28746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:13.238090 28746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6484b5a5d3734016845b4be338591a61, State: Initialized, Role: FOLLOWER
I20260811 14:59:13.238518 28746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } }
I20260811 14:59:13.238662 28746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:59:13.238716 28746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:59:13.238795 28746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:13.239725 28746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } }
I20260811 14:59:13.240032 28746 leader_election.cc:302] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6484b5a5d3734016845b4be338591a61; no voters:
I20260811 14:59:13.240296 28746 leader_election.cc:288] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:59:13.240428 28751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:59:13.240648 28751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [term 1 LEADER]: Becoming Leader. State: Replica: 6484b5a5d3734016845b4be338591a61, State: Running, Role: LEADER
I20260811 14:59:13.241039 28751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } }
I20260811 14:59:13.241637 28746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:59:13.242815 28754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6484b5a5d3734016845b4be338591a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } } }
I20260811 14:59:13.242966 28754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:13.243373 28767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:59:13.243325 28756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6484b5a5d3734016845b4be338591a61. Latest consensus state: current_term: 1 leader_uuid: "6484b5a5d3734016845b4be338591a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6484b5a5d3734016845b4be338591a61" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33735 } } }
I20260811 14:59:13.244092 28756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:13.246558 28767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:59:13.252907 28767 catalog_manager.cc:1347] Generated new cluster ID: 30e341fcf32d4cbeb0a9f1fa13dbbf13
I20260811 14:59:13.252982 28767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:59:13.259387 28767 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:59:13.260236 28767 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:59:13.266929 28767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6484b5a5d3734016845b4be338591a61: Generated new TSK 0
I20260811 14:59:13.267601 28767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:59:13.270785 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--builtin_ntp_servers=127.11.225.84:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 14:59:13.408609 28792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:13.408862 28792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:13.408900 28792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:13.413012 28792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:13.413074 28792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:13.413128 28792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:59:13.417870 28792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:13.418980 28792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:13.420383 28792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:13.429791 28807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.429813 28806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.429919 28792 server_base.cc:1034] running on GCE node
W20260811 14:59:13.429813 28810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.430474 28792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:13.431085 28792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:13.432253 28792 hybrid_clock.cc:648] HybridClock initialized: now 1786460353432242 us; error 28 us; skew 500 ppm
I20260811 14:59:13.434124 28792 webserver.cc:460] Webserver started at http://127.11.225.65:43167/ using document root <none> and password file <none>
I20260811 14:59:13.434641 28792 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:13.434697 28792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:13.434856 28792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:13.436805 28792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "c1327dbeb8154021ac9a38a89f621db5"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ad17da22c9d41a8ddac23cbe6f61b512"
server_key_iv: "754925ca79ffe75aaa37804edecb7e44"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.437399 28792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "c1327dbeb8154021ac9a38a89f621db5"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ad17da22c9d41a8ddac23cbe6f61b512"
server_key_iv: "754925ca79ffe75aaa37804edecb7e44"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.440956 28792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 14:59:13.443598 28823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.444834 28792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:59:13.444927 28792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "c1327dbeb8154021ac9a38a89f621db5"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ad17da22c9d41a8ddac23cbe6f61b512"
server_key_iv: "754925ca79ffe75aaa37804edecb7e44"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.445010 28792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:13.467861 28792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:13.468516 28792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:13.468676 28792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:13.469235 28792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:13.470304 28792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:13.470351 28792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.470422 28792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:13.470465 28792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.479295 28792 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:40527
I20260811 14:59:13.479324 29021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:40527 every 8 connection(s)
I20260811 14:59:13.480233 28792 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:59:13.489836 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 28792
I20260811 14:59:13.489965 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:59:13.490314 12165 external_mini_cluster.cc:1428] Setting key 873df008e3fe30a7f0e81694454b9f38
I20260811 14:59:13.490319 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.482335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:47187 (local address 127.11.225.126:33735)
0811 14:59:13.482494 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:13.482499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:13.483659 (+ 1160us) server_negotiation.cc:407] Connection header received
0811 14:59:13.485164 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:13.485168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:13.485262 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:13.485359 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:13.486294 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.486860 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.488103 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.488361 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.488492 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.489790 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:13.489793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:13.489796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:13.489811 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:13.489835 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:13.489844 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:13.489936 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:13.490137 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 14:59:13.490204 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 14:59:13.491385 29031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.482751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33735 (local address 127.11.225.65:47187)
0811 14:59:13.483478 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:13.483522 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:13.484921 (+ 1399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:13.485561 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:13.485567 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:13.485652 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:13.486137 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.486150 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.487035 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.487039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.487941 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.487953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.488534 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.488539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.488712 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.489384 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:13.489386 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:13.489426 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:13.489488 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:13.489961 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:13.489974 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:13.489983 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 14:59:13.490125 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 14:59:13.490434 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":144,"threads_started":1}
I20260811 14:59:13.492609 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--builtin_ntp_servers=127.11.225.84:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 14:59:13.492697 29024 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33735
I20260811 14:59:13.492928 29024 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:13.493502 29024 heartbeater.cc:511] Master 127.11.225.126:33735 requested a full tablet report, sending...
I20260811 14:59:13.495044 28683 ts_manager.cc:194] Registered new tserver with Master: c1327dbeb8154021ac9a38a89f621db5 (127.11.225.65:40527)
I20260811 14:59:13.496178 28683 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.65:47187
W20260811 14:59:13.607592 29035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:13.607815 29035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:13.607851 29035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:13.611966 29035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:13.612020 29035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:13.612102 29035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:59:13.616724 29035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:13.617861 29035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:13.619212 29035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:13.628891 29050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.628891 29047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.628958 29045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.629094 29035 server_base.cc:1034] running on GCE node
I20260811 14:59:13.629596 29035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:13.630226 29035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:13.631414 29035 hybrid_clock.cc:648] HybridClock initialized: now 1786460353631386 us; error 41 us; skew 500 ppm
I20260811 14:59:13.638095 29035 webserver.cc:460] Webserver started at http://127.11.225.66:37235/ using document root <none> and password file <none>
I20260811 14:59:13.638692 29035 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:13.638789 29035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:13.639055 29035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:13.641129 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "362b58cbe4114c4c9ba2ef1e465e8f6a"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "4d38bb4e41604e5a124874433912d4ac"
server_key_iv: "0a6c14e0fa10611d308caf497601460b"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.641826 29035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "362b58cbe4114c4c9ba2ef1e465e8f6a"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "4d38bb4e41604e5a124874433912d4ac"
server_key_iv: "0a6c14e0fa10611d308caf497601460b"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.645694 29035 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 14:59:13.648226 29059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.649700 29035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:59:13.649816 29035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "362b58cbe4114c4c9ba2ef1e465e8f6a"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "4d38bb4e41604e5a124874433912d4ac"
server_key_iv: "0a6c14e0fa10611d308caf497601460b"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.649945 29035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:13.677577 29035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:13.678367 29035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:13.678579 29035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:13.679207 29035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:13.680222 29035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:13.680299 29035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.680375 29035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:13.680431 29035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.689275 29035 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:42821
I20260811 14:59:13.689338 29271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:42821 every 8 connection(s)
I20260811 14:59:13.690385 29035 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:59:13.690753 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 29035
I20260811 14:59:13.690886 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:59:13.691228 12165 external_mini_cluster.cc:1428] Setting key 671291646b4a647038625e691338fe86
I20260811 14:59:13.693683 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--builtin_ntp_servers=127.11.225.84:46879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 14:59:13.702407 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.692615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:50207 (local address 127.11.225.126:33735)
0811 14:59:13.692756 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:13.692762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:13.694248 (+ 1486us) server_negotiation.cc:407] Connection header received
0811 14:59:13.696255 (+ 2007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:13.696262 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:13.696334 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:13.696464 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:13.697426 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.698004 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.699965 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.700202 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.700298 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.701848 (+ 1550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:13.701852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:13.701854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:13.701867 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:13.701891 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:13.701901 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:13.701977 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:13.702220 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 14:59:13.702286 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 14:59:13.703707 29276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.693206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33735 (local address 127.11.225.66:50207)
0811 14:59:13.694083 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:13.694152 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:13.696014 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:13.696608 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:13.696614 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:13.696703 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:13.697275 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.697294 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.698179 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.698186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.699810 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.699825 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.700378 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.700384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.700643 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.701487 (+ 844us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:13.701491 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:13.701553 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:13.701663 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:13.702001 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:13.702014 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:13.702022 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 14:59:13.702164 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 14:59:13.702505 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":146,"threads_started":1}
I20260811 14:59:13.705118 29274 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33735
I20260811 14:59:13.705396 29274 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:13.705972 29274 heartbeater.cc:511] Master 127.11.225.126:33735 requested a full tablet report, sending...
I20260811 14:59:13.707127 28683 ts_manager.cc:194] Registered new tserver with Master: 362b58cbe4114c4c9ba2ef1e465e8f6a (127.11.225.66:42821)
I20260811 14:59:13.707719 28683 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.66:50207
W20260811 14:59:13.814103 29277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:13.814355 29277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:13.814392 29277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:13.818385 29277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:13.818439 29277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:13.818490 29277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:59:13.823216 29277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:13.824306 29277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:13.825783 29277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:13.835590 29288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.835590 29293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:13.835632 29291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:13.835846 29277 server_base.cc:1034] running on GCE node
I20260811 14:59:13.836304 29277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:13.836992 29277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:13.838181 29277 hybrid_clock.cc:648] HybridClock initialized: now 1786460353838149 us; error 52 us; skew 500 ppm
I20260811 14:59:13.839953 29277 webserver.cc:460] Webserver started at http://127.11.225.67:42189/ using document root <none> and password file <none>
I20260811 14:59:13.840540 29277 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:13.840637 29277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:13.840876 29277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:13.843071 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "e0553598ddf642448df2ecf391087e7b"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ece4a2b3b9076c949fa369e9aa3c63b9"
server_key_iv: "577d4262b6bb93f067b7156443dfdcc3"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.843765 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "e0553598ddf642448df2ecf391087e7b"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ece4a2b3b9076c949fa369e9aa3c63b9"
server_key_iv: "577d4262b6bb93f067b7156443dfdcc3"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.847430 29277 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 14:59:13.850225 29313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.851401 29277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:59:13.851537 29277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "e0553598ddf642448df2ecf391087e7b"
format_stamp: "Formatted at 2026-08-11 14:59:13 on dist-test-slave-8hhm"
server_key: "ece4a2b3b9076c949fa369e9aa3c63b9"
server_key_iv: "577d4262b6bb93f067b7156443dfdcc3"
server_key_version: "encryptionkey@0"
I20260811 14:59:13.851667 29277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:13.875438 29277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:13.876212 29277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:13.876426 29277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:13.877074 29277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:13.878140 29277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:13.878216 29277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.878291 29277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:13.878336 29277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:13.887339 29277 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:46123
I20260811 14:59:13.887367 29504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:46123 every 8 connection(s)
I20260811 14:59:13.888270 29277 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:59:13.892215 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 29277
I20260811 14:59:13.892304 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:59:13.892575 12165 external_mini_cluster.cc:1428] Setting key c6ce8899932d46beb58943c380164993
I20260811 14:59:13.898151 28749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.890335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:34139 (local address 127.11.225.126:33735)
0811 14:59:13.890521 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:13.890526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:13.891634 (+ 1108us) server_negotiation.cc:407] Connection header received
0811 14:59:13.893185 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:13.893188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:13.893281 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:13.893374 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:13.894443 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.895151 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.896289 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.896503 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.896598 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.897722 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:13.897726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:13.897728 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:13.897741 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:13.897761 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:13.897768 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:13.897828 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:13.897966 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 14:59:13.898031 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 14:59:13.898988 29510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:13.890801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33735 (local address 127.11.225.67:34139)
0811 14:59:13.891473 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:13.891515 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:13.892942 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:13.893605 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:13.893612 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:13.893701 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:13.894293 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.894306 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.895279 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.895282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.896166 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:13.896176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:13.896659 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:13.896662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:13.896800 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:13.897466 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:13.897468 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:13.897508 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:13.897572 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:13.897843 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:13.897850 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:13.897854 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:59:13.897947 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 14:59:13.898173 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":129,"threads_started":1}
I20260811 14:59:13.900075 29507 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33735
I20260811 14:59:13.900298 29507 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:13.900789 29507 heartbeater.cc:511] Master 127.11.225.126:33735 requested a full tablet report, sending...
I20260811 14:59:13.901777 28683 ts_manager.cc:194] Registered new tserver with Master: e0553598ddf642448df2ecf391087e7b (127.11.225.67:46123)
I20260811 14:59:13.902343 28683 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.67:34139
I20260811 14:59:13.906667 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:59:13.909529 28749 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:13.908547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38902 (local address 127.11.225.126:33735)
0811 14:59:13.908675 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:13.908678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:13.908849 (+ 171us) server_negotiation.cc:407] Connection header received
0811 14:59:13.908931 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:13.908933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:13.908969 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:13.909034 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:13.909378 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38902: BlockingRecv error: recv got EOF from 127.0.0.1:38902 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:59:13.909684 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 28792
I20260811 14:59:13.940434 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 29035
I20260811 14:59:13.968209 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 29277
I20260811 14:59:13.984897 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 28634
2026-08-11T14:59:13Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (983 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T14:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:59:14Z Disabled control of system clock
I20260811 14:59:14.018448 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42143
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:42143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:59:14.132964 29531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:14.133355 29531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:14.133399 29531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:14.137467 29531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:59:14.137543 29531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:14.137559 29531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:14.137576 29531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:59:14.137593 29531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:59:14.142371 29531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:42143
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:42143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:14.143411 29531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:14.144783 29531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:14.153481 29546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:14.153467 29531 server_base.cc:1034] running on GCE node
W20260811 14:59:14.153453 29543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.153460 29544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:14.154337 29531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:14.155426 29531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:14.156633 29531 hybrid_clock.cc:648] HybridClock initialized: now 1786460354156595 us; error 48 us; skew 500 ppm
I20260811 14:59:14.158672 29531 webserver.cc:460] Webserver started at http://127.11.225.126:35687/ using document root <none> and password file <none>
I20260811 14:59:14.159271 29531 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:14.159369 29531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:14.159617 29531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:14.161800 29531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "3256257d40e64e3b80d908911b2a0870"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "d83a33ff16d8236bd3419a41250959fe"
server_key_iv: "c5e90060db3573f55d69d02e6deb3050"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.162395 29531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "3256257d40e64e3b80d908911b2a0870"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "d83a33ff16d8236bd3419a41250959fe"
server_key_iv: "c5e90060db3573f55d69d02e6deb3050"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.166152 29531 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 14:59:14.168583 29557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.169871 29531 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 14:59:14.170019 29531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "3256257d40e64e3b80d908911b2a0870"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "d83a33ff16d8236bd3419a41250959fe"
server_key_iv: "c5e90060db3573f55d69d02e6deb3050"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.170135 29531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:14.174793 29531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:14.175407 29531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:14.175598 29531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:14.182806 29531 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:42143
I20260811 14:59:14.182852 29642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:42143 every 8 connection(s)
I20260811 14:59:14.183779 29531 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:59:14.184934 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 29531
I20260811 14:59:14.185060 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:59:14.185410 12165 external_mini_cluster.cc:1428] Setting key f21019d53cf20941f96bb06b0f2373d4
I20260811 14:59:14.187255 29644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:14.191641 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.186848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50418 (local address 127.11.225.126:42143)
0811 14:59:14.187944 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:14.187960 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:14.187998 (+ 38us) server_negotiation.cc:407] Connection header received
0811 14:59:14.188785 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:14.188805 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:14.189163 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:14.189507 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:14.190331 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:14.190335 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:14.190347 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:14.190356 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:14.190409 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:14.190424 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:14.190539 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:14.190650 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 14:59:14.190918 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":621,"threads_started":1}
I20260811 14:59:14.194098 29644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870: Bootstrap starting.
I20260811 14:59:14.196188 29644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:14.196942 29644 log.cc:824] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:14.199044 29644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870: No bootstrap required, opened a new log
I20260811 14:59:14.202625 29644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } }
I20260811 14:59:14.202865 29644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:14.202958 29644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3256257d40e64e3b80d908911b2a0870, State: Initialized, Role: FOLLOWER
I20260811 14:59:14.203428 29644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } }
I20260811 14:59:14.203603 29644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:59:14.203686 29644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:59:14.203814 29644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:14.204671 29644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } }
I20260811 14:59:14.205015 29644 leader_election.cc:302] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3256257d40e64e3b80d908911b2a0870; no voters:
I20260811 14:59:14.205369 29644 leader_election.cc:288] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:59:14.205518 29653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:59:14.205770 29653 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [term 1 LEADER]: Becoming Leader. State: Replica: 3256257d40e64e3b80d908911b2a0870, State: Running, Role: LEADER
I20260811 14:59:14.206135 29653 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } }
I20260811 14:59:14.206560 29644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:59:14.207945 29656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3256257d40e64e3b80d908911b2a0870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } } }
I20260811 14:59:14.207974 29659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3256257d40e64e3b80d908911b2a0870. Latest consensus state: current_term: 1 leader_uuid: "3256257d40e64e3b80d908911b2a0870" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3256257d40e64e3b80d908911b2a0870" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 42143 } } }
I20260811 14:59:14.208066 29656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:14.208077 29659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:14.208410 29670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:59:14.211721 29670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:59:14.217407 29670 catalog_manager.cc:1347] Generated new cluster ID: 6f22fa76ba714fd497837eb60ae212ae
I20260811 14:59:14.217489 29670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:59:14.228972 29670 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:59:14.229323 29670 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:59:14.233789 29670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3256257d40e64e3b80d908911b2a0870: Generated new TSK 0
I20260811 14:59:14.234457 29670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 14:59:14.243700 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--builtin_ntp_servers=127.11.225.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 14:59:14.360040 29686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:14.360345 29686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:14.360385 29686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:14.364308 29686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:14.364358 29686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:14.364413 29686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:59:14.369004 29686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:14.370056 29686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:14.371420 29686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:14.382133 29698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.382164 29699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.382164 29701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:14.382870 29686 server_base.cc:1034] running on GCE node
I20260811 14:59:14.383237 29686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:14.383803 29686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:14.385006 29686 hybrid_clock.cc:648] HybridClock initialized: now 1786460354384979 us; error 38 us; skew 500 ppm
I20260811 14:59:14.386899 29686 webserver.cc:460] Webserver started at http://127.11.225.65:46757/ using document root <none> and password file <none>
I20260811 14:59:14.387508 29686 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:14.387605 29686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:14.387820 29686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:14.389961 29686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "954faf290bf34beba644d180ee28ccf6"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "f94ea80974a642407c3e9378928499fd"
server_key_iv: "6b36ca41adaf5c4b98d1785c2f38ef65"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.390532 29686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "954faf290bf34beba644d180ee28ccf6"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "f94ea80974a642407c3e9378928499fd"
server_key_iv: "6b36ca41adaf5c4b98d1785c2f38ef65"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.394323 29686 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 14:59:14.396785 29712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.398044 29686 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:59:14.398195 29686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "954faf290bf34beba644d180ee28ccf6"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "f94ea80974a642407c3e9378928499fd"
server_key_iv: "6b36ca41adaf5c4b98d1785c2f38ef65"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.398313 29686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:14.403105 29686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:14.403708 29686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:14.403896 29686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:14.404443 29686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:14.405422 29686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:14.405490 29686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.405570 29686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:14.405620 29686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.415133 29686 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:37433
I20260811 14:59:14.415164 29925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:37433 every 8 connection(s)
I20260811 14:59:14.416026 29686 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:59:14.421936 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 29686
I20260811 14:59:14.422060 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:59:14.422433 12165 external_mini_cluster.cc:1428] Setting key d36482235e8c686a5614b952b8aeb3d7
I20260811 14:59:14.422783 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.417877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36611 (local address 127.11.225.126:42143)
0811 14:59:14.418033 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:14.418038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:14.419161 (+ 1123us) server_negotiation.cc:407] Connection header received
0811 14:59:14.420650 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:14.420654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:14.420701 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:14.420821 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:14.422213 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:14.422219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:14.422221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:14.422238 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:14.422264 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:14.422276 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:14.422392 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:14.422593 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 14:59:14.422640 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 14:59:14.423733 29929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.418237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:42143 (local address 127.11.225.65:36611)
0811 14:59:14.418936 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:14.419017 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:14.420407 (+ 1390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:14.421018 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:14.421025 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:14.421116 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:14.421872 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:14.421874 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:14.421917 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:14.422025 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:14.422401 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:14.422410 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:14.422416 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 14:59:14.422635 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 14:59:14.422883 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":109,"threads_started":1}
I20260811 14:59:14.424548 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--builtin_ntp_servers=127.11.225.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 14:59:14.425051 29926 heartbeater.cc:347] Connected to a master server at 127.11.225.126:42143
I20260811 14:59:14.425338 29926 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:14.425770 29926 heartbeater.cc:511] Master 127.11.225.126:42143 requested a full tablet report, sending...
I20260811 14:59:14.427249 29588 ts_manager.cc:194] Registered new tserver with Master: 954faf290bf34beba644d180ee28ccf6 (127.11.225.65:37433)
W20260811 14:59:14.542266 29930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:14.542512 29930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:14.542551 29930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:14.546558 29930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:14.546613 29930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:14.546667 29930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:59:14.551403 29930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:14.552470 29930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:14.553930 29930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:14.563630 29941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.563654 29945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.563645 29938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:14.563735 29930 server_base.cc:1034] running on GCE node
I20260811 14:59:14.564369 29930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:14.564970 29930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:14.566185 29930 hybrid_clock.cc:648] HybridClock initialized: now 1786460354566150 us; error 36 us; skew 500 ppm
I20260811 14:59:14.568040 29930 webserver.cc:460] Webserver started at http://127.11.225.66:46551/ using document root <none> and password file <none>
I20260811 14:59:14.568636 29930 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:14.568703 29930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:14.568924 29930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:14.571085 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "4e222da857bd4c32a03be1ba21a9247e"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "484d37bb11c2bdcae795e37b9e89646c"
server_key_iv: "a9cb0bae9c5b4606cde87ad4b5b8bcf9"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.571691 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "4e222da857bd4c32a03be1ba21a9247e"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "484d37bb11c2bdcae795e37b9e89646c"
server_key_iv: "a9cb0bae9c5b4606cde87ad4b5b8bcf9"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.575574 29930 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:59:14.578312 29956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.579562 29930 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:59:14.579701 29930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "4e222da857bd4c32a03be1ba21a9247e"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "484d37bb11c2bdcae795e37b9e89646c"
server_key_iv: "a9cb0bae9c5b4606cde87ad4b5b8bcf9"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.579815 29930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:14.584481 29930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:14.585141 29930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:14.585343 29930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:14.585887 29930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:14.586804 29930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:14.586853 29930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.586891 29930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:14.586948 29930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.596025 29930 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:34889
I20260811 14:59:14.596046 30164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:34889 every 8 connection(s)
I20260811 14:59:14.596887 29930 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:59:14.602180 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 29930
I20260811 14:59:14.602319 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:59:14.602689 12165 external_mini_cluster.cc:1428] Setting key 62671d913be897e0cdbfc951b4a34e46
I20260811 14:59:14.603250 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.598798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:58627 (local address 127.11.225.126:42143)
0811 14:59:14.598936 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:14.598940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:14.599972 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 14:59:14.601407 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:14.601411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:14.601461 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:14.601536 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:14.602728 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:14.602734 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:14.602736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:14.602751 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:14.602777 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:14.602789 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:14.602890 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:14.603084 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 14:59:14.603142 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 14:59:14.604282 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.599197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:42143 (local address 127.11.225.66:58627)
0811 14:59:14.599831 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:14.599869 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:14.601071 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:14.601697 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:14.601703 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:14.601782 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:14.602469 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:14.602470 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:14.602509 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:14.602574 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:14.602879 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:14.602887 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:14.602891 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 14:59:14.603071 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 14:59:14.603327 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
I20260811 14:59:14.605051 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--builtin_ntp_servers=127.11.225.84:35729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 14:59:14.605461 30165 heartbeater.cc:347] Connected to a master server at 127.11.225.126:42143
I20260811 14:59:14.605700 30165 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:14.606122 30165 heartbeater.cc:511] Master 127.11.225.126:42143 requested a full tablet report, sending...
I20260811 14:59:14.607249 29588 ts_manager.cc:194] Registered new tserver with Master: 4e222da857bd4c32a03be1ba21a9247e (127.11.225.66:34889)
W20260811 14:59:14.722276 30169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:14.722535 30169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:14.722640 30169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:14.726676 30169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:14.726733 30169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:14.726787 30169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:59:14.731621 30169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:42143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:14.732748 30169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:14.734133 30169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:59:14.743801 30169 server_base.cc:1034] running on GCE node
W20260811 14:59:14.743827 30184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.743820 30186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:14.743801 30183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:14.744551 30169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:14.745299 30169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:14.746506 30169 hybrid_clock.cc:648] HybridClock initialized: now 1786460354746490 us; error 25 us; skew 500 ppm
I20260811 14:59:14.748416 30169 webserver.cc:460] Webserver started at http://127.11.225.67:34045/ using document root <none> and password file <none>
I20260811 14:59:14.749025 30169 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:14.749121 30169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:14.749413 30169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:14.751448 30169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "4dd004acb42b4beeb40fbfa27b57e0cd"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "36919b75a30da6692079ae53e4e313af"
server_key_iv: "2656221b28e7dc4db8f5e78fd6a1c9ac"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.752035 30169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "4dd004acb42b4beeb40fbfa27b57e0cd"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "36919b75a30da6692079ae53e4e313af"
server_key_iv: "2656221b28e7dc4db8f5e78fd6a1c9ac"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.755940 30169 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 14:59:14.758675 30195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.759865 30169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 14:59:14.760046 30169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "4dd004acb42b4beeb40fbfa27b57e0cd"
format_stamp: "Formatted at 2026-08-11 14:59:14 on dist-test-slave-8hhm"
server_key: "36919b75a30da6692079ae53e4e313af"
server_key_iv: "2656221b28e7dc4db8f5e78fd6a1c9ac"
server_key_version: "encryptionkey@0"
I20260811 14:59:14.760170 30169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:14.764645 30169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:14.765264 30169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:14.765446 30169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:14.766016 30169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:14.766906 30169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:14.766986 30169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.767050 30169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:14.767102 30169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:14.776355 30169 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37443
I20260811 14:59:14.776388 30389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37443 every 8 connection(s)
I20260811 14:59:14.777283 30169 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:59:14.782864 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 30169
I20260811 14:59:14.782953 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:59:14.783376 12165 external_mini_cluster.cc:1428] Setting key 1cbbb15f89278c430a538479cec93985
I20260811 14:59:14.783599 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.779099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:54071 (local address 127.11.225.126:42143)
0811 14:59:14.779242 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:14.779246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:14.780307 (+ 1061us) server_negotiation.cc:407] Connection header received
0811 14:59:14.781717 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:14.781720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:14.781758 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:14.781838 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:14.783054 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:14.783058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:14.783061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 14:59:14.783075 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:14.783102 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 14:59:14.783113 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:14.783236 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:14.783374 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 14:59:14.783424 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:59:14.784646 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:14.779544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:42143 (local address 127.11.225.67:54071)
0811 14:59:14.780183 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:14.780222 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:14.781519 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:14.782042 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:14.782050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:14.782138 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:14.782751 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 14:59:14.782753 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:14.782794 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 14:59:14.782862 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:14.783215 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:14.783221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:14.783226 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 14:59:14.783377 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 14:59:14.783646 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260811 14:59:14.785823 30390 heartbeater.cc:347] Connected to a master server at 127.11.225.126:42143
I20260811 14:59:14.786056 30390 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:14.786459 30390 heartbeater.cc:511] Master 127.11.225.126:42143 requested a full tablet report, sending...
I20260811 14:59:14.787509 29587 ts_manager.cc:194] Registered new tserver with Master: 4dd004acb42b4beeb40fbfa27b57e0cd (127.11.225.67:37443)
I20260811 14:59:14.797451 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 14:59:14.800452 29651 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 14:59:14.799427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.11.225.126:42143)
0811 14:59:14.799590 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:14.799595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:14.799748 (+ 153us) server_negotiation.cc:407] Connection header received
0811 14:59:14.799907 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:14.799910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:14.799952 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:14.800081 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:14.800321 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50432: BlockingRecv error: recv got EOF from 127.0.0.1:50432 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 14:59:14.800776 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 29686
I20260811 14:59:14.825763 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 29930
I20260811 14:59:14.844951 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 30169
I20260811 14:59:14.857491 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 29531
2026-08-11T14:59:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (880 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:59:14 dist-test-slave-8hhm krb5kdc[30413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:59:14 dist-test-slave-8hhm krb5kdc[30413](info): set up 2 sockets
Aug 11 14:59:14 dist-test-slave-8hhm krb5kdc[30413](info): commencing operation
krb5kdc: starting...
W20260811 14:59:16.148556 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:59:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:59:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 14:59:16.280037 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35433
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:35433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:59:16.396925 30439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:16.397185 30439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:16.397289 30439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:16.401371 30439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 14:59:16.401427 30439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:16.401446 30439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:16.401487 30439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 14:59:16.401518 30439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 14:59:16.407028 30439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:35433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:16.408125 30439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:16.409183 30439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:16.418141 30451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:16.418169 30445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:16.418229 30439 server_base.cc:1034] running on GCE node
W20260811 14:59:16.418177 30448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:16.418977 30439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:16.420076 30439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:16.421295 30439 hybrid_clock.cc:648] HybridClock initialized: now 1786460356421258 us; error 39 us; skew 500 ppm
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:59:16.424196 30439 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 14:59:16.425114 30439 webserver.cc:460] Webserver started at http://127.11.225.126:33043/ using document root <none> and password file <none>
I20260811 14:59:16.425709 30439 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:16.425771 30439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:16.425936 30439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:16.428023 30439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "3112fc0d20b94f24994b02a193f85166"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "a7fb285e991ce376e164ea34e72a8274"
server_key_iv: "6917f0baa723b50a3fb38cd458c5cced"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.428635 30439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "3112fc0d20b94f24994b02a193f85166"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "a7fb285e991ce376e164ea34e72a8274"
server_key_iv: "6917f0baa723b50a3fb38cd458c5cced"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.432483 30439 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 14:59:16.435065 30463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.436329 30439 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:59:16.436484 30439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "3112fc0d20b94f24994b02a193f85166"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "a7fb285e991ce376e164ea34e72a8274"
server_key_iv: "6917f0baa723b50a3fb38cd458c5cced"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.436604 30439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:16.454090 30439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:16.457687 30439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:16.457927 30439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:16.465449 30439 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:35433
I20260811 14:59:16.465806 30554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:35433 every 8 connection(s)
I20260811 14:59:16.466511 30439 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 14:59:16.466920 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 30439
I20260811 14:59:16.467049 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 14:59:16.467368 12165 external_mini_cluster.cc:1428] Setting key 8dd10274b336c95ccb4ec01ecd00a85e
I20260811 14:59:16.469885 30558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:16.475385 30558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: Bootstrap starting.
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:59:16.477991 30558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:16.478727 30558 log.cc:824] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:16.480597 30558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: No bootstrap required, opened a new log
I20260811 14:59:16.482336 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:16.468920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36498 (local address 127.11.225.126:35433)
0811 14:59:16.469428 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:16.469451 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:16.469492 (+ 41us) server_negotiation.cc:407] Connection header received
0811 14:59:16.470244 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:16.470264 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:16.470590 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:16.470945 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:16.471782 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.472790 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.473784 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.474244 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.474423 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:16.477349 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:16.477353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:16.477366 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:59:16.477393 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:16.479328 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:16.479809 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:16.479814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:16.479818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:16.479929 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:16.480230 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:16.480234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:16.480235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:16.480629 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:16.480858 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:16.481166 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 14:59:16.481466 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":195,"threads_started":1}
I20260811 14:59:16.483719 30558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } }
I20260811 14:59:16.484010 30558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:16.484087 30558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3112fc0d20b94f24994b02a193f85166, State: Initialized, Role: FOLLOWER
I20260811 14:59:16.484539 30558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } }
I20260811 14:59:16.484709 30558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 14:59:16.484763 30558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 14:59:16.484834 30558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:16.485687 30558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } }
I20260811 14:59:16.485962 30558 leader_election.cc:302] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3112fc0d20b94f24994b02a193f85166; no voters:
I20260811 14:59:16.486204 30558 leader_election.cc:288] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 14:59:16.486357 30571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:59:16.486620 30571 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [term 1 LEADER]: Becoming Leader. State: Replica: 3112fc0d20b94f24994b02a193f85166, State: Running, Role: LEADER
I20260811 14:59:16.486936 30571 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } }
I20260811 14:59:16.487390 30558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 14:59:16.488686 30573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3112fc0d20b94f24994b02a193f85166. Latest consensus state: current_term: 1 leader_uuid: "3112fc0d20b94f24994b02a193f85166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } } }
I20260811 14:59:16.488812 30573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:16.489465 30572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3112fc0d20b94f24994b02a193f85166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3112fc0d20b94f24994b02a193f85166" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35433 } } }
I20260811 14:59:16.489634 30572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166 [sys.catalog]: This master's current role is: LEADER
I20260811 14:59:16.489980 30582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 14:59:16.493103 30582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 14:59:16.498502 30582 catalog_manager.cc:1347] Generated new cluster ID: 95d47b3afc3f433fb9c8682fe60f7579
I20260811 14:59:16.498584 30582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 14:59:16.519346 30582 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 14:59:16.520341 30582 catalog_manager.cc:1504] Loading token signing keys...
I20260811 14:59:16.525575 30582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: Generated new TSK 0
I20260811 14:59:16.526296 30582 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 14:59:16.555675 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:59:16.673108 30607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:16.673393 30607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:16.673439 30607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:16.677311 30607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:16.677363 30607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:16.677417 30607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 14:59:16.683105 30607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:16.684156 30607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:16.685178 30607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:16.695498 30615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:16.695516 30613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:16.695556 30617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:16.695979 30607 server_base.cc:1034] running on GCE node
I20260811 14:59:16.696415 30607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:16.697054 30607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:16.698218 30607 hybrid_clock.cc:648] HybridClock initialized: now 1786460356698199 us; error 29 us; skew 500 ppm
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:59:16.701061 30607 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 14:59:16.702035 30607 webserver.cc:460] Webserver started at http://127.11.225.65:43623/ using document root <none> and password file <none>
I20260811 14:59:16.702634 30607 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:16.702700 30607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:16.702877 30607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:16.705050 30607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "19c0047c9f624f6fb497be41227281f9"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "d3e17d9fd21da804a6b0af6a4bc68741"
server_key_iv: "2168309caf11055164c564b74b8eadfc"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.705638 30607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "19c0047c9f624f6fb497be41227281f9"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "d3e17d9fd21da804a6b0af6a4bc68741"
server_key_iv: "2168309caf11055164c564b74b8eadfc"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.709174 30607 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:59:16.711666 30629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.712977 30607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 14:59:16.713112 30607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "19c0047c9f624f6fb497be41227281f9"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "d3e17d9fd21da804a6b0af6a4bc68741"
server_key_iv: "2168309caf11055164c564b74b8eadfc"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.713258 30607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:16.751058 30607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:16.754359 30607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:16.754577 30607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:16.755199 30607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:16.756139 30607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:16.756207 30607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.756282 30607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:16.756336 30607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.765677 30607 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:39623
I20260811 14:59:16.765728 30813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:39623 every 8 connection(s)
I20260811 14:59:16.766637 30607 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 14:59:16.773685 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 30607
I20260811 14:59:16.773806 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 14:59:16.774137 12165 external_mini_cluster.cc:1428] Setting key f9cb57b5f837822e8c9a854061ecad6b
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:59:16.781904 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:16.768519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:33773 (local address 127.11.225.126:35433)
0811 14:59:16.768675 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:16.768680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:16.769611 (+ 931us) server_negotiation.cc:407] Connection header received
0811 14:59:16.770977 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:16.770980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:16.771028 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:16.771106 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:16.772292 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.772885 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.774438 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.774807 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.774896 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:16.777740 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:16.777746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:16.777751 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:59:16.777785 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:16.779355 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:16.780001 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:16.780004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:16.780005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:16.780109 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:16.780533 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:16.780535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:16.780536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:16.780713 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:16.780787 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:16.781543 (+ 756us) server_negotiation.cc:299] Negotiation successful
0811 14:59:16.781700 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:59:16.783030 30816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:16.768977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35433 (local address 127.11.225.65:33773)
0811 14:59:16.769449 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:16.769504 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:16.770769 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:16.771271 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:16.771278 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:16.771637 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:16.772123 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:16.772136 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.773024 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.773027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:16.774296 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:16.774307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:16.774973 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:16.774977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:16.775151 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:16.775811 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:16.775831 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:16.777572 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:16.779454 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:16.779469 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:16.779487 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:16.779870 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:16.780207 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:16.780213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:16.780218 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:16.780417 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:16.780820 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:16.780829 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:16.781201 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 14:59:16.781449 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 14:59:16.781836 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":108,"threads_started":1}
I20260811 14:59:16.784384 30814 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35433
I20260811 14:59:16.784658 30814 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:16.785202 30814 heartbeater.cc:511] Master 127.11.225.126:35433 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 14:59:16.786811 30491 ts_manager.cc:194] Registered new tserver with Master: 19c0047c9f624f6fb497be41227281f9 (127.11.225.65:39623)
I20260811 14:59:16.788134 30491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:33773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 14:59:16.804651 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:59:16.925995 30820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:16.926298 30820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:16.926386 30820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:16.930553 30820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:16.930646 30820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:16.930740 30820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 14:59:16.936322 30820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:16.937559 30820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:16.938616 30820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 14:59:16.948859 30820 server_base.cc:1034] running on GCE node
W20260811 14:59:16.948796 30835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:16.948812 30833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:16.948836 30838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:16.949622 30820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:16.950270 30820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:16.951439 30820 hybrid_clock.cc:648] HybridClock initialized: now 1786460356951421 us; error 29 us; skew 500 ppm
Aug 11 14:59:16 dist-test-slave-8hhm krb5kdc[30413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:59:16.954607 30820 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 14:59:16.955518 30820 webserver.cc:460] Webserver started at http://127.11.225.66:40779/ using document root <none> and password file <none>
I20260811 14:59:16.956135 30820 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:16.956200 30820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:16.956539 30820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:16.958784 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "6f1722898362207397d9967de50c95d3"
server_key_iv: "96382382ed4622c7d39ee942a40a050d"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.959403 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "6f1722898362207397d9967de50c95d3"
server_key_iv: "96382382ed4622c7d39ee942a40a050d"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.963543 30820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 14:59:16.966200 30849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.967506 30820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 14:59:16.967665 30820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7"
format_stamp: "Formatted at 2026-08-11 14:59:16 on dist-test-slave-8hhm"
server_key: "6f1722898362207397d9967de50c95d3"
server_key_iv: "96382382ed4622c7d39ee942a40a050d"
server_key_version: "encryptionkey@0"
I20260811 14:59:16.967784 30820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:16.984272 30820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:16.987784 30820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:16.987989 30820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:16.988794 30820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:16.989904 30820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:16.989984 30820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.990075 30820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:16.990113 30820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:16.999948 30820 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:34629
I20260811 14:59:16.999977 31052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:34629 every 8 connection(s)
I20260811 14:59:17.000936 30820 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 14:59:17.003985 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 30820
I20260811 14:59:17.004102 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 14:59:17.004441 12165 external_mini_cluster.cc:1428] Setting key 453d08a3a9480a59bdf3bc57cf26bff9
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[30413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 14:59:17.016681 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.002966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:57629 (local address 127.11.225.126:35433)
0811 14:59:17.003118 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.003123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.004190 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 14:59:17.006016 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.006021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.006076 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.006179 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:17.007873 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.008604 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.009924 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.010181 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.010275 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.012949 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:17.012953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:17.012955 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:59:17.012995 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:17.014552 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.015088 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.015092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.015094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.015179 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.015533 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.015537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.015538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.015725 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:17.015855 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.016373 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.016499 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 14:59:17.017612 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.003403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35433 (local address 127.11.225.66:57629)
0811 14:59:17.004013 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.004076 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.005767 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.006395 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.006405 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.006946 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:17.007709 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.007733 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.008764 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.008767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.009790 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.009800 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.010324 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.010326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.010476 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.011174 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:17.011190 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:17.012768 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:17.014696 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:17.014703 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:17.014718 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:17.014979 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:17.015276 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:17.015280 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:17.015282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:17.015427 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:17.015862 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:17.015871 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:17.016123 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.016312 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.016647 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":124,"threads_started":1}
I20260811 14:59:17.018960 31053 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35433
I20260811 14:59:17.019220 31053 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 14:59:17.019770 31053 heartbeater.cc:511] Master 127.11.225.126:35433 requested a full tablet report, sending...
I20260811 14:59:17.020949 30491 ts_manager.cc:194] Registered new tserver with Master: 7a6de830e56143ebb2c3fcc2c2ee66d7 (127.11.225.66:34629)
I20260811 14:59:17.021818 30491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:57629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 14:59:17.036695 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 14:59:17.150645 31061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 14:59:17.150898 31061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 14:59:17.150941 31061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 14:59:17.154953 31061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 14:59:17.155012 31061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 14:59:17.155098 31061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 14:59:17.160386 31061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 14:59:17.161445 31061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 14:59:17.162468 31061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 14:59:17.172256 31068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:17.172251 31069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 14:59:17.172333 31071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 14:59:17.172480 31061 server_base.cc:1034] running on GCE node
I20260811 14:59:17.173007 31061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 14:59:17.173735 31061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 14:59:17.174922 31061 hybrid_clock.cc:648] HybridClock initialized: now 1786460357174907 us; error 27 us; skew 500 ppm
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[30413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460357, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 14:59:17.177853 31061 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 14:59:17.178772 31061 webserver.cc:460] Webserver started at http://127.11.225.67:46511/ using document root <none> and password file <none>
I20260811 14:59:17.179335 31061 fs_manager.cc:359] Metadata directory not provided
I20260811 14:59:17.179431 31061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 14:59:17.179679 31061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 14:59:17.181802 31061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "7af681f87b354fbbab4c1315b347a728"
format_stamp: "Formatted at 2026-08-11 14:59:17 on dist-test-slave-8hhm"
server_key: "27f2c88886858df6fe6b71c035410b09"
server_key_iv: "d50e5d1b146bffc8c5bae3a48f305058"
server_key_version: "encryptionkey@0"
I20260811 14:59:17.182374 31061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "7af681f87b354fbbab4c1315b347a728"
format_stamp: "Formatted at 2026-08-11 14:59:17 on dist-test-slave-8hhm"
server_key: "27f2c88886858df6fe6b71c035410b09"
server_key_iv: "d50e5d1b146bffc8c5bae3a48f305058"
server_key_version: "encryptionkey@0"
I20260811 14:59:17.186164 31061 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 14:59:17.188750 31080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:17.190129 31061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 14:59:17.190237 31061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "7af681f87b354fbbab4c1315b347a728"
format_stamp: "Formatted at 2026-08-11 14:59:17 on dist-test-slave-8hhm"
server_key: "27f2c88886858df6fe6b71c035410b09"
server_key_iv: "d50e5d1b146bffc8c5bae3a48f305058"
server_key_version: "encryptionkey@0"
I20260811 14:59:17.190321 31061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 14:59:17.201762 31061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 14:59:17.204622 31061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 14:59:17.204770 31061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 14:59:17.205390 31061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 14:59:17.206209 31061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 14:59:17.206257 31061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:17.206306 31061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 14:59:17.206331 31061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 14:59:17.215943 31061 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37323
I20260811 14:59:17.215962 31264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37323 every 8 connection(s)
I20260811 14:59:17.217010 31061 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 14:59:17.223985 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 31061
I20260811 14:59:17.224116 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 14:59:17.224392 12165 external_mini_cluster.cc:1428] Setting key 0dd8e2a2acafa7dcd4415bea1f6b2123
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[30413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460357, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 14:59:17.231220 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.218938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:42415 (local address 127.11.225.126:35433)
0811 14:59:17.219091 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.219096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.220013 (+ 917us) server_negotiation.cc:407] Connection header received
0811 14:59:17.221448 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.221451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.221512 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.221590 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:17.222783 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.223320 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.224582 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.224895 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.225023 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.227839 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:17.227848 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:17.227850 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:59:17.227873 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:17.229116 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.229657 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.229661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.229663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.229750 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.230113 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.230116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.230118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.230305 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:17.230413 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.230922 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.231047 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 14:59:17.232057 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.219405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35433 (local address 127.11.225.67:42415)
0811 14:59:17.219859 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.219902 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.221183 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.221755 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.221761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.222170 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 14:59:17.222641 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.222654 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.223431 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.223433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.224442 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.224455 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.225088 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.225094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.225342 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.226024 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 14:59:17.226045 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 14:59:17.227680 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 14:59:17.229256 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:17.229263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:17.229279 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:17.229551 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:17.229847 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 14:59:17.229851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 14:59:17.229853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 14:59:17.230000 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 14:59:17.230413 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 14:59:17.230420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 14:59:17.230672 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.230867 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.231191 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":121,"threads_started":1}
I20260811 14:59:17.233274 31265 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35433
I20260811 14:59:17.233564 31265 heartbeater.cc:464] Registering TS with master...
I20260811 14:59:17.234097 31265 heartbeater.cc:511] Master 127.11.225.126:35433 requested a full tablet report, sending...
I20260811 14:59:17.235162 30491 ts_manager.cc:194] Registered new tserver with Master: 7af681f87b354fbbab4c1315b347a728 (127.11.225.67:37323)
I20260811 14:59:17.235852 30491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:42415
I20260811 14:59:17.238687 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 14:59:17.248061 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.240925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36510 (local address 127.11.225.126:35433)
0811 14:59:17.241050 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.241054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.241114 (+ 60us) server_negotiation.cc:407] Connection header received
0811 14:59:17.241270 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.241273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.241309 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.241374 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 14:59:17.242048 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.242533 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.243320 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.243536 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.243611 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.244939 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 14:59:17.244942 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 14:59:17.244944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 14:59:17.244967 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 14:59:17.246368 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.246747 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.246750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.246751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.246825 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 14:59:17.247106 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 14:59:17.247109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 14:59:17.247110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 14:59:17.247352 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 14:59:17.247462 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.247654 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.247867 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 14:59:17.250865 30491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 14:59:17.253979 30491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 14:59:17.269246 31289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.263992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34629 (local address 127.0.0.1:51866)
0811 14:59:17.264392 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.264406 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.264478 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.265182 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.265186 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.265203 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:59:17.265309 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.265315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.266697 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.266703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.267512 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.267522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.268619 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.268623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.268739 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.268766 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.268822 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.268999 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":32,"thread_start_us":89,"threads_started":1}
I20260811 14:59:17.269452 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.262975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41800 (local address 127.11.225.65:39623)
0811 14:59:17.263393 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.263423 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.263458 (+ 35us) server_negotiation.cc:407] Connection header received
0811 14:59:17.263675 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.263682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.263912 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.264113 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:59:17.264648 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.265716 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.267682 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.268381 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.268521 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.268690 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.268885 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.268999 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":98,"threads_started":1}
I20260811 14:59:17.269243 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.262783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:39623 (local address 127.0.0.1:41800)
0811 14:59:17.263228 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.263285 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.263433 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.264328 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.264338 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.264368 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:59:17.264504 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.264512 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.266027 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.266031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.267538 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.267549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.268515 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.268519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.268623 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.268711 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.268848 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.269015 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":86,"thread_start_us":113,"threads_started":1}
I20260811 14:59:17.269788 31290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.264188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51866 (local address 127.11.225.66:34629)
0811 14:59:17.264722 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.264730 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.264749 (+ 19us) server_negotiation.cc:407] Connection header received
0811 14:59:17.264811 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.264814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.265004 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.265205 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:59:17.265397 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.266504 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.267650 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.268465 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.269328 (+ 863us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.269489 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.269549 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.269648 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":145,"threads_started":1}
I20260811 14:59:17.270179 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.263617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37323 (local address 127.0.0.1:46278)
0811 14:59:17.264298 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.264313 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.264474 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.264986 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.264989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.265005 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:59:17.265139 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.265150 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.266654 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.266657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.267843 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.267852 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.269076 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.269079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.269179 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.269201 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.269944 (+ 743us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.270024 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":40,"thread_start_us":117,"threads_started":1}
I20260811 14:59:17.270568 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.263774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46278 (local address 127.11.225.67:37323)
0811 14:59:17.264250 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.264262 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.264395 (+ 133us) server_negotiation.cc:407] Connection header received
0811 14:59:17.264619 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.264626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.264819 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.264993 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:59:17.265310 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.266502 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.267970 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.268767 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.268865 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.269004 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.270124 (+ 1120us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.270237 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":142,"threads_started":1}
I20260811 14:59:17.273141 31160 tablet_service.cc:1467] Processing CreateTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 (DEFAULT_TABLE table=test-table [id=acbc965eebad4b12bb9b6081f2ceec25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:59:17.273128 30703 tablet_service.cc:1467] Processing CreateTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 (DEFAULT_TABLE table=test-table [id=acbc965eebad4b12bb9b6081f2ceec25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:59:17.273128 30942 tablet_service.cc:1467] Processing CreateTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 (DEFAULT_TABLE table=test-table [id=acbc965eebad4b12bb9b6081f2ceec25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 14:59:17.274271 31160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f847f6903649b9aa17e728c5a5ce73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:17.274277 30703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f847f6903649b9aa17e728c5a5ce73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:17.274278 30942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6f847f6903649b9aa17e728c5a5ce73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 14:59:17.280488 31297 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Bootstrap starting.
I20260811 14:59:17.282022 31298 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Bootstrap starting.
I20260811 14:59:17.283631 31297 tablet_bootstrap.cc:654] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:17.284391 31298 tablet_bootstrap.cc:654] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:17.284629 31297 log.cc:824] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:17.285295 31298 log.cc:824] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:17.285470 31299 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Bootstrap starting.
I20260811 14:59:17.286860 31297 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: No bootstrap required, opened a new log
I20260811 14:59:17.287124 31297 ts_tablet_manager.cc:1397] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 14:59:17.287459 31298 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: No bootstrap required, opened a new log
I20260811 14:59:17.287657 31298 ts_tablet_manager.cc:1397] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 14:59:17.288314 31299 tablet_bootstrap.cc:654] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Neither blocks nor log segments found. Creating new log.
I20260811 14:59:17.289234 31299 log.cc:824] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Log is configured to *not* fsync() on all Append() calls
I20260811 14:59:17.291162 31297 raft_consensus.cc:348] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.291435 31299 tablet_bootstrap.cc:492] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: No bootstrap required, opened a new log
I20260811 14:59:17.291466 31297 raft_consensus.cc:374] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:17.291569 31297 raft_consensus.cc:729] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af681f87b354fbbab4c1315b347a728, State: Initialized, Role: FOLLOWER
I20260811 14:59:17.291666 31299 ts_tablet_manager.cc:1397] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 14:59:17.292075 31297 consensus_queue.cc:260] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.292089 31298 raft_consensus.cc:348] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.292340 31298 raft_consensus.cc:374] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:17.292390 31298 raft_consensus.cc:729] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19c0047c9f624f6fb497be41227281f9, State: Initialized, Role: FOLLOWER
I20260811 14:59:17.292804 31298 consensus_queue.cc:260] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.293097 31297 ts_tablet_manager.cc:1428] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 14:59:17.293563 30814 heartbeater.cc:503] Master 127.11.225.126:35433 was elected leader, sending a full tablet report...
I20260811 14:59:17.293906 31298 ts_tablet_manager.cc:1428] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 14:59:17.294680 31265 heartbeater.cc:503] Master 127.11.225.126:35433 was elected leader, sending a full tablet report...
I20260811 14:59:17.295481 31299 raft_consensus.cc:348] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.295799 31299 raft_consensus.cc:374] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 14:59:17.295893 31299 raft_consensus.cc:729] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a6de830e56143ebb2c3fcc2c2ee66d7, State: Initialized, Role: FOLLOWER
I20260811 14:59:17.296360 31299 consensus_queue.cc:260] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.297150 31053 heartbeater.cc:503] Master 127.11.225.126:35433 was elected leader, sending a full tablet report...
I20260811 14:59:17.297390 31299 ts_tablet_manager.cc:1428] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 14:59:17.468089 31267 tablet.cc:2369] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 14:59:17.502262 31055 tablet.cc:2369] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:59:17.502935 31306 raft_consensus.cc:482] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 14:59:17.503214 31306 raft_consensus.cc:504] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.504407 31306 leader_election.cc:288] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19c0047c9f624f6fb497be41227281f9 (127.11.225.65:39623), 7a6de830e56143ebb2c3fcc2c2ee66d7 (127.11.225.66:34629)
I20260811 14:59:17.508185 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.504723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:39623 (local address 127.11.225.67:55821)
0811 14:59:17.504863 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.504881 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.504982 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.505323 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.505327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.505348 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:59:17.505479 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.505486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.506250 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.506255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.507091 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.507100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.507743 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.507747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.507859 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.507886 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.507979 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.508048 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":21}
I20260811 14:59:17.508185 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.504857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:55821 (local address 127.11.225.65:39623)
0811 14:59:17.504987 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.504991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.505007 (+ 16us) server_negotiation.cc:407] Connection header received
0811 14:59:17.505092 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.505095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.505150 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.505303 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:59:17.505599 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.506130 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.507226 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.507620 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.507752 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.507812 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.507998 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.508082 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 14:59:17.508728 31313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.505109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34629 (local address 127.11.225.67:58885)
0811 14:59:17.505528 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.505540 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 14:59:17.505662 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 14:59:17.505931 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 14:59:17.505934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 14:59:17.505950 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 14:59:17.506073 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.506078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.506785 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.506790 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.507594 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 14:59:17.507603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.508253 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.508257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 14:59:17.508362 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.508388 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 14:59:17.508518 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 14:59:17.508585 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":21,"thread_start_us":162,"threads_started":1}
I20260811 14:59:17.508791 31290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.505296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:58885 (local address 127.11.225.66:34629)
0811 14:59:17.505504 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.505509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.505633 (+ 124us) server_negotiation.cc:407] Connection header received
0811 14:59:17.505781 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.505784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.505835 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.505920 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 14:59:17.506189 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.506672 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.507725 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.508117 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.508253 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.508300 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.508574 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.508680 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260811 14:59:17.508941 30736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6f847f6903649b9aa17e728c5a5ce73" candidate_uuid: "7af681f87b354fbbab4c1315b347a728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c0047c9f624f6fb497be41227281f9" is_pre_election: true
I20260811 14:59:17.509346 30736 raft_consensus.cc:2454] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7af681f87b354fbbab4c1315b347a728 in term 0.
I20260811 14:59:17.509508 30981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6f847f6903649b9aa17e728c5a5ce73" candidate_uuid: "7af681f87b354fbbab4c1315b347a728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" is_pre_election: true
I20260811 14:59:17.509867 30981 raft_consensus.cc:2454] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7af681f87b354fbbab4c1315b347a728 in term 0.
I20260811 14:59:17.509896 31086 leader_election.cc:302] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19c0047c9f624f6fb497be41227281f9, 7af681f87b354fbbab4c1315b347a728; no voters:
I20260811 14:59:17.510186 31306 raft_consensus.cc:2781] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 14:59:17.510325 31306 raft_consensus.cc:482] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 14:59:17.510393 31306 raft_consensus.cc:3037] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:17.511471 31306 raft_consensus.cc:504] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
I20260811 14:59:17.511831 31306 leader_election.cc:288] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [CANDIDATE]: Term 1 election: Requested vote from peers 19c0047c9f624f6fb497be41227281f9 (127.11.225.65:39623), 7a6de830e56143ebb2c3fcc2c2ee66d7 (127.11.225.66:34629)
I20260811 14:59:17.512253 30981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6f847f6903649b9aa17e728c5a5ce73" candidate_uuid: "7af681f87b354fbbab4c1315b347a728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7"
I20260811 14:59:17.512244 30736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6f847f6903649b9aa17e728c5a5ce73" candidate_uuid: "7af681f87b354fbbab4c1315b347a728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c0047c9f624f6fb497be41227281f9"
I20260811 14:59:17.512368 30736 raft_consensus.cc:3037] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:17.512368 30981 raft_consensus.cc:3037] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 14:59:17.513753 30736 raft_consensus.cc:2454] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7af681f87b354fbbab4c1315b347a728 in term 1.
I20260811 14:59:17.513753 30981 raft_consensus.cc:2454] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7af681f87b354fbbab4c1315b347a728 in term 1.
I20260811 14:59:17.514045 31086 leader_election.cc:302] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19c0047c9f624f6fb497be41227281f9, 7af681f87b354fbbab4c1315b347a728; no voters:
I20260811 14:59:17.514245 31306 raft_consensus.cc:2781] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 14:59:17.514509 31306 raft_consensus.cc:686] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 1 LEADER]: Becoming Leader. State: Replica: 7af681f87b354fbbab4c1315b347a728, State: Running, Role: LEADER
I20260811 14:59:17.514861 31306 consensus_queue.cc:237] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } }
W20260811 14:59:17.518005 30815 tablet.cc:2369] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 14:59:17.518486 30491 catalog_manager.cc:5495] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7af681f87b354fbbab4c1315b347a728 (127.11.225.67). New cstate: current_term: 1 leader_uuid: "7af681f87b354fbbab4c1315b347a728" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7af681f87b354fbbab4c1315b347a728" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 } health_report { overall_health: UNKNOWN } } }
I20260811 14:59:17.560766 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.557098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46294 (local address 127.11.225.67:37323)
0811 14:59:17.557280 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 14:59:17.557286 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 14:59:17.557308 (+ 22us) server_negotiation.cc:407] Connection header received
0811 14:59:17.557402 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 14:59:17.557405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 14:59:17.557462 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 14:59:17.557576 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 14:59:17.557839 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.558352 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.559228 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 14:59:17.559461 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 14:59:17.559579 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 14:59:17.559905 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 14:59:17.560352 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 14:59:17.560522 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 14:59:17.560561 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 14:59:17.560619 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 14:59:17.567317 30981 raft_consensus.cc:1261] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 1 FOLLOWER]: Refusing update from remote peer 7af681f87b354fbbab4c1315b347a728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:59:17.567317 30736 raft_consensus.cc:1261] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9 [term 1 FOLLOWER]: Refusing update from remote peer 7af681f87b354fbbab4c1315b347a728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 14:59:17.568142 31317 consensus_queue.cc:1035] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19c0047c9f624f6fb497be41227281f9" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:59:17.568369 31306 consensus_queue.cc:1035] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a6de830e56143ebb2c3fcc2c2ee66d7" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 34629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 14:59:17.578230 31323 mvcc.cc:205] Tried to move back new op lower bound from 7317341624586448896 to 7317341624383635456. Current Snapshot: MvccSnapshot[applied={T|T < 7317341624586448896}]
I20260811 14:59:17.586243 30488 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:59:17.586421 30488 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 14:59:17.588990 30488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3112fc0d20b94f24994b02a193f85166: Sending DeleteTablet for 3 replicas of tablet d6f847f6903649b9aa17e728c5a5ce73
I20260811 14:59:17.589942 31160 tablet_service.cc:1514] Processing DeleteTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:59:17 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:46278
I20260811 14:59:17.589895 30703 tablet_service.cc:1514] Processing DeleteTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:59:17 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:41800
I20260811 14:59:17.590095 30942 tablet_service.cc:1514] Processing DeleteTablet for tablet d6f847f6903649b9aa17e728c5a5ce73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 14:59:17 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:51866
I20260811 14:59:17.590639 31339 tablet_replica.cc:330] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: stopping tablet replica
I20260811 14:59:17.590701 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 30607
I20260811 14:59:17.590904 31335 tablet_replica.cc:330] T d6f847f6903649b9aa17e728c5a5ce73 P 19c0047c9f624f6fb497be41227281f9: stopping tablet replica
I20260811 14:59:17.591455 31339 raft_consensus.cc:2229] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 1 LEADER]: Raft consensus shutting down.
I20260811 14:59:17.591972 31339 raft_consensus.cc:2258] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:59:17.596940 31339 ts_tablet_manager.cc:1905] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 14:59:17.600203 31339 ts_tablet_manager.cc:1918] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 14:59:17.600411 31339 log.cc:1196] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/d6f847f6903649b9aa17e728c5a5ce73
I20260811 14:59:17.600925 31339 ts_tablet_manager.cc:1939] T d6f847f6903649b9aa17e728c5a5ce73 P 7af681f87b354fbbab4c1315b347a728: Deleting consensus metadata
I20260811 14:59:17.602466 30468 catalog_manager.cc:4841] TS 7af681f87b354fbbab4c1315b347a728 (127.11.225.67:37323): tablet d6f847f6903649b9aa17e728c5a5ce73 (table test-table [id=acbc965eebad4b12bb9b6081f2ceec25]) successfully deleted
I20260811 14:59:17.605485 31341 tablet_replica.cc:330] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: stopping tablet replica
I20260811 14:59:17.605873 31341 raft_consensus.cc:2229] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 14:59:17.606289 31341 raft_consensus.cc:2258] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 14:59:17.608045 31341 ts_tablet_manager.cc:1905] T d6f847f6903649b9aa17e728c5a5ce73 P 7a6de830e56143ebb2c3fcc2c2ee66d7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 14:59:17.610248 30468 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:39623 (error 108)
I20260811 14:59:17.610387 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 30820
I20260811 14:59:17.615101 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.614653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:39623 (local address 127.0.0.1:41802)
0811 14:59:17.614850 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.614972 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:39623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 14:59:17.615428 30468 catalog_manager.cc:4584] TS 19c0047c9f624f6fb497be41227281f9 (127.11.225.65:39623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d6f847f6903649b9aa17e728c5a5ce73: Network error: Client connection negotiation failed: client connection to 127.11.225.65:39623: connect: Connection refused (error 111)
I20260811 14:59:17.623484 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 31061
I20260811 14:59:17.623713 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 14:59:17.623362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:34629 (local address 127.0.0.1:51882)
0811 14:59:17.623529 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 14:59:17.623603 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.66:34629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 14:59:17.636826 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 30439
2026-08-11T14:59:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2778 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[31347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[31347](info): set up 2 sockets
Aug 11 14:59:17 dist-test-slave-8hhm krb5kdc[31347](info): commencing operation
krb5kdc: starting...
W20260811 14:59:18.938854 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 14:59:19 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T14:59:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T14:59:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangeradmin_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangeradmin_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangerlookup_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangerlookup_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
I20260811 14:59:19.126667 12165 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasknb3eKX/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/postgres -l logfile start
2026-08-11 14:59:21.698 UTC [31408] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 14:59:21.698 UTC [31408] LOG: listening on IPv4 address "127.11.225.84", port 36383
2026-08-11 14:59:21.701 UTC [31408] LOG: listening on Unix socket "/tmp/.s.PGSQL.36383"
2026-08-11 14:59:21.725 UTC [31411] LOG: database system was shut down at 2026-08-11 14:59:20 UTC
2026-08-11 14:59:21.729 UTC [31408] LOG: database system is ready to accept connections
I20260811 14:59:22.940517 12165 mini_postgres.cc:96] Postgres bound to 36383
2026-08-11 14:59:22.949 UTC [31424] FATAL: database "slave" does not exist
127.11.225.84:36383 - accepting connections
I20260811 14:59:22.949967 12165 mini_ranger.cc:161] Starting Ranger...
I20260811 14:59:22.966295 12165 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 14:59:23.458576 12165 mini_ranger.cc:87] Created ranger Postgres database
I20260811 14:59:23.458696 12165 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin
2026-08-11 14:59:23,790 [I] DB FLAVOR :POSTGRES
2026-08-11 14:59:23,790 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:59:23,790 [I] Checking connection..
2026-08-11 14:59:23,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 14:59:24,082 [I] Checking connection passed.
2026-08-11 14:59:24,083 [I] --------- Verifying version history table ---------
2026-08-11 14:59:24,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:59:24,356 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:59:24,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:59:24,623 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 14:59:24,623 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 14:59:24,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 14:59:24.874 UTC [31529] WARNING: there is no transaction in progress
2026-08-11 14:59:24,884 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 14:59:24,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 14:59:25,163 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 14:59:25,164 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:59:25,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 14:59:25,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 14:59:25,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8hhm.c.gcp-upstream.internal','N') ;"
2026-08-11 14:59:25,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:59:26,180 [I] Table x_portal_user does not exist in database ranger
2026-08-11 14:59:26,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:59:26,432 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 14:59:26,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:59:26,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:59:26,954 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 14:59:26,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 14:59:27.996 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.013 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.030 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.046 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.066 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.085 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.142 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.149 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.163 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.173 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.184 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.197 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.206 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.213 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.220 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28.228 UTC [31716] WARNING: there is no transaction in progress
2026-08-11 14:59:28,901 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 14:59:28,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 14:59:29,149 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 14:59:29,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 14:59:29,399 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 14:59:29,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 14:59:29,649 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 14:59:29,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 14:59:29,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 14:59:30,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8hhm.c.gcp-upstream.internal';"
2026-08-11 14:59:30,420 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 14:59:30,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 14:59:30,665 [I] DB_PATCHES have already been applied
I20260811 14:59:30.671707 12165 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasknb3eKX/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 14:59:30.671772 12165 mini_ranger.cc:193] Using host: 127.11.225.84
I20260811 14:59:30.676433 12165 mini_ranger.cc:227] Ranger admin URL: http://127.11.225.84:32789
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 2:59:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 14:59:32.109546 12165 mini_ranger.cc:160] Time spent starting Ranger: real 9.160s user 0.000s sys 0.013s
Aug 11, 2026 2:59:52 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 2:59:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 2:59:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 2:59:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 2:59:53 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 14:59:54.536847 12165 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangerkms_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/rangerkms_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.225.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.225.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 14:59:54 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460394, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 14:59:54.652073 12165 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 14:59:54.664991 12165 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 14:59:55.533334 12165 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 14:59:55.533419 12165 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms
I20260811 14:59:55.533543 12165 mini_ranger_kms.cc:227] Using postgres at 127.11.225.84:36383
2026-08-11 14:59:55,780 [I] DB FLAVOR :POSTGRES
2026-08-11 14:59:55,780 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 14:59:55,781 [I] Checking connection
2026-08-11 14:59:55,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 14:59:56,045 [I] connection success
2026-08-11 14:59:56,045 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 14:59:56,045 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 14:59:56,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 14:59:56,293 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 14:59:56,293 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 14:59:56,294 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 14:59:56,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:36383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 14:59:56,559 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 14:59:57.033555 12165 mini_ranger_kms.cc:310] Created kms service
I20260811 14:59:57.259985 12165 mini_ranger_kms.cc:326] Created kudu user
I20260811 14:59:57.305002 12165 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 14:59:57 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460394, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 14:59:57.738188 12165 mini_ranger_kms.cc:384] Added ranger policy
I20260811 14:59:57.738345 12165 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms:/tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 14:59:57.738377 12165 mini_ranger_kms.cc:240] Using host: 127.11.225.84
I20260811 14:59:57.744199 12165 mini_ranger_kms.cc:276] Ranger KMS PID: 32058
I20260811 14:59:57.744371 12165 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.225.84:52523
Aug 11, 2026 2:59:58 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:59:58 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:59:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 2:59:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 2:59:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 2:59:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 15:00:00 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460400, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 15:00:00 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460400, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:00.639843 12165 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.988s user 0.019s sys 0.212s
I20260811 15:00:00.639972 12165 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 15:00:00.640075 12165 mini_ranger_kms.cc:401] 127.11.225.84:52523/kms/v1/keys
Aug 11 15:00:00 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460400, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
Aug 11 15:00:03 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:00:03.432873 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33333
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:38195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33333
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:52523/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:03.569628 32150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:03.569934 32150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:03.570009 32150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:03.574164 32150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:00:03.574255 32150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:03.574293 32150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:03.574326 32150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:00:03.574364 32150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:00:03.580071 32150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:38195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.225.84:52523/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33333
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:03.581329 32150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:03.582409 32150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:03.591745 32160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:03.591934 32150 server_base.cc:1034] running on GCE node
W20260811 15:00:03.591794 32159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:03.591976 32162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:03.592772 32150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:03.594017 32150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:03.595206 32150 hybrid_clock.cc:648] HybridClock initialized: now 1786460403595179 us; error 45 us; skew 500 ppm
Aug 11 15:00:03 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460403, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:03.598453 32150 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:00:03.599610 32150 webserver.cc:460] Webserver started at http://127.11.225.126:40577/ using document root <none> and password file <none>
I20260811 15:00:03.600313 32150 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:03.600401 32150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:03.600651 32150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:03 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460403, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:03.655263 32150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "d8d92cee04ad434e9219264d86d7b956"
format_stamp: "Formatted at 2026-08-11 15:00:03 on dist-test-slave-8hhm"
server_key: "0b8fd1c4e579c79ba883e0c27b955aad"
server_key_iv: "4fafd7223c7b9ce60d836e43fd0e4155"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:03.656020 32150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "d8d92cee04ad434e9219264d86d7b956"
format_stamp: "Formatted at 2026-08-11 15:00:03 on dist-test-slave-8hhm"
server_key: "0b8fd1c4e579c79ba883e0c27b955aad"
server_key_iv: "4fafd7223c7b9ce60d836e43fd0e4155"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:03.660856 32150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 15:00:03.679993 32172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:03.681689 32150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:00:03.681876 32150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "d8d92cee04ad434e9219264d86d7b956"
format_stamp: "Formatted at 2026-08-11 15:00:03 on dist-test-slave-8hhm"
server_key: "0b8fd1c4e579c79ba883e0c27b955aad"
server_key_iv: "4fafd7223c7b9ce60d836e43fd0e4155"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:03.682029 32150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:03.697971 32150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:03.701354 32150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:03.701599 32150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:03.709856 32150 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:33333
I20260811 15:00:03.709867 32262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:33333 every 8 connection(s)
I20260811 15:00:03.710881 32150 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:00:03.713519 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 32150
I20260811 15:00:03.713652 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:00:03.713951 12165 external_mini_cluster.cc:1428] Setting key 21a5fbeecf53edb182a9cae851bf7087
I20260811 15:00:03.714025 32263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:03.721140 32263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: Bootstrap starting.
Aug 11 15:00:03 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:03.723766 32263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:03.724722 32263 log.cc:824] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:03.727162 32263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: No bootstrap required, opened a new log
I20260811 15:00:03.729982 32266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:03.715451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57836 (local address 127.11.225.126:33333)
0811 15:00:03.715946 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:03.715962 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:03.715998 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:00:03.716917 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:03.716938 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:03.717374 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:03.717751 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:03.718642 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:03.719691 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:03.720596 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:03.721148 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:03.721372 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:03.724395 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:03.724401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:03.724416 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:03.724445 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:03.726909 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:03.727445 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:03.727449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:03.727454 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:03.727566 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:03.727878 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:03.727880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:03.727881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:03.728304 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:03.728457 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:03.728807 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 15:00:03.729138 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":170,"threads_started":1}
I20260811 15:00:03.730886 32263 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } }
I20260811 15:00:03.731115 32263 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:03.731199 32263 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8d92cee04ad434e9219264d86d7b956, State: Initialized, Role: FOLLOWER
I20260811 15:00:03.731632 32263 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } }
I20260811 15:00:03.731771 32263 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:00:03.731861 32263 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:00:03.731997 32263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:03.732923 32263 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } }
I20260811 15:00:03.733335 32263 leader_election.cc:302] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8d92cee04ad434e9219264d86d7b956; no voters:
I20260811 15:00:03.733659 32263 leader_election.cc:288] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:00:03.733791 32268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:00:03.734084 32268 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [term 1 LEADER]: Becoming Leader. State: Replica: d8d92cee04ad434e9219264d86d7b956, State: Running, Role: LEADER
I20260811 15:00:03.734488 32268 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } }
I20260811 15:00:03.734989 32263 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:00:03.736476 32270 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8d92cee04ad434e9219264d86d7b956. Latest consensus state: current_term: 1 leader_uuid: "d8d92cee04ad434e9219264d86d7b956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } } }
I20260811 15:00:03.736799 32270 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:03.737174 32269 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8d92cee04ad434e9219264d86d7b956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8d92cee04ad434e9219264d86d7b956" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33333 } } }
I20260811 15:00:03.737375 32269 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956 [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:03.737944 32284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:00:03.738142 32263 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:00:03.743414 32284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:00:03.752116 32284 catalog_manager.cc:1347] Generated new cluster ID: 0fcfc400eb4c40e5a630f527f9e10989
I20260811 15:00:03.752198 32284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:00:03.762194 32284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:00:03.763620 32284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:00:03.775959 32284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: Generated new TSK 0
I20260811 15:00:03.776957 32284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:00:04.496563 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:52523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:38195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:04.627393 32337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:04.627737 32337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:04.627810 32337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:04.632237 32337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:04.632313 32337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:04.632376 32337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:00:04.638692 32337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:38195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.225.84:52523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:04.639922 32337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:04.641042 32337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:04.652145 32353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:04.652642 32349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:04.652859 32350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:04.654174 32337 server_base.cc:1034] running on GCE node
I20260811 15:00:04.654752 32337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:04.655565 32337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:04.656759 32337 hybrid_clock.cc:648] HybridClock initialized: now 1786460404656725 us; error 45 us; skew 500 ppm
Aug 11 15:00:04 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:04.660698 32337 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:00:04.661967 32337 webserver.cc:460] Webserver started at http://127.11.225.65:37609/ using document root <none> and password file <none>
I20260811 15:00:04.662736 32337 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:04.662832 32337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:04.663098 32337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:04 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:04.680353 32337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "7cca872ac7ea4052891e388d16cc971c"
format_stamp: "Formatted at 2026-08-11 15:00:04 on dist-test-slave-8hhm"
server_key: "39a1c210916dd54671ce8c08693a20a7"
server_key_iv: "a8e2cc02dc22d10a669b384056bcc74d"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:04.681310 32337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "7cca872ac7ea4052891e388d16cc971c"
format_stamp: "Formatted at 2026-08-11 15:00:04 on dist-test-slave-8hhm"
server_key: "39a1c210916dd54671ce8c08693a20a7"
server_key_iv: "a8e2cc02dc22d10a669b384056bcc74d"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:04.685907 32337 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:00:04.709789 32367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:04.711540 32337 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260811 15:00:04.711792 32337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "7cca872ac7ea4052891e388d16cc971c"
format_stamp: "Formatted at 2026-08-11 15:00:04 on dist-test-slave-8hhm"
server_key: "39a1c210916dd54671ce8c08693a20a7"
server_key_iv: "a8e2cc02dc22d10a669b384056bcc74d"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:04.712025 32337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:04.733759 32337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:04.737984 32337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:04.738273 32337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:04.739100 32337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:04.740262 32337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:04.740377 32337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:04.740501 32337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:04.740612 32337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:04.752417 32337 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:44045
I20260811 15:00:04.754118 32337 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:00:04.756119 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 32337
I20260811 15:00:04.756243 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:00:04.756564 12165 external_mini_cluster.cc:1428] Setting key 138be83abb47ff6c5be4a62243100a8d
I20260811 15:00:04.761500 32560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:44045 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Aug 11 15:00:04 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:04.788501 32567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:04.765174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33333 (local address 127.11.225.65:38747)
0811 15:00:04.769813 (+ 4639us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:04.769881 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:04.771228 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:04.772160 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:04.772171 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:04.772617 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:04.773404 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:04.773428 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:04.774797 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:04.774801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:04.776084 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:04.776096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:04.776873 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:04.776880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:04.777169 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:04.777906 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:04.777933 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:04.781333 (+ 3400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:04.783894 (+ 2561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:04.783902 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:04.783924 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:04.784337 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:04.785194 (+ 857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:04.785197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:04.785200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:04.785521 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:04.786178 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:04.786187 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:04.786645 (+ 458us) client_negotiation.cc:769] Sending connection context
0811 15:00:04.786945 (+ 300us) client_negotiation.cc:240] Negotiation successful
0811 15:00:04.787347 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4358,"thread_start_us":186,"threads_started":1}
I20260811 15:00:04.789179 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:04.764587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:38747 (local address 127.11.225.126:33333)
0811 15:00:04.769489 (+ 4902us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:04.769501 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:04.771589 (+ 2088us) server_negotiation.cc:407] Connection header received
0811 15:00:04.771649 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:04.771654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:04.771735 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:04.771861 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:04.773628 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:04.774618 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:04.776249 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:04.776517 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:04.776639 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:04.781597 (+ 4958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:04.781601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:04.781604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:04.781639 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:04.783723 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:04.784473 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:04.784477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:04.784479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:04.784580 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:04.785662 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:04.785666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:04.785668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:04.786012 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:04.786117 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:04.788838 (+ 2721us) server_negotiation.cc:299] Negotiation successful
0811 15:00:04.788977 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4786,"thread_start_us":123,"threads_started":1}
I20260811 15:00:04.791085 32562 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33333
I20260811 15:00:04.791358 32562 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:04.792062 32562 heartbeater.cc:511] Master 127.11.225.126:33333 requested a full tablet report, sending...
I20260811 15:00:04.794186 32208 ts_manager.cc:194] Registered new tserver with Master: 7cca872ac7ea4052891e388d16cc971c (127.11.225.65:44045)
I20260811 15:00:04.795807 32208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:38747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:00:04.812858 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:52523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:38195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:00:04 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 15:00:04.984913 32572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:04.985464 32572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:04.985538 32572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:04.991255 32572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:04.991325 32572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:04.991390 32572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:00:04.998517 32572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:38195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.225.84:52523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:05.000036 32572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:05.001508 32572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:05.014873 32586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:05.015393 32584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:05.014878 32583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:05.015643 32572 server_base.cc:1034] running on GCE node
I20260811 15:00:05.016326 32572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:05.017341 32572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:05.024781 32572 hybrid_clock.cc:648] HybridClock initialized: now 1786460405024730 us; error 68 us; skew 500 ppm
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:05.029290 32572 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:00:05.030646 32572 webserver.cc:460] Webserver started at http://127.11.225.66:34081/ using document root <none> and password file <none>
I20260811 15:00:05.031419 32572 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:05.031536 32572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:05.031833 32572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:05.056905 32572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "c4b66dfd141644adac0e435ba2d39022"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "7f99c6ca029be3eb063adde491dbb303"
server_key_iv: "08bb5216710ee35e2f83870c106e35cf"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.057790 32572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "c4b66dfd141644adac0e435ba2d39022"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "7f99c6ca029be3eb063adde491dbb303"
server_key_iv: "08bb5216710ee35e2f83870c106e35cf"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.063529 32572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 15:00:05.084071 32597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.086170 32572 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260811 15:00:05.086407 32572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c4b66dfd141644adac0e435ba2d39022"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "7f99c6ca029be3eb063adde491dbb303"
server_key_iv: "08bb5216710ee35e2f83870c106e35cf"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.086733 32572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:05.114429 32572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:05.118685 32572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:05.119006 32572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:05.119894 32572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:05.121176 32572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:05.121322 32572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.121438 32572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:05.121517 32572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.134060 32572 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:39427
I20260811 15:00:05.134251 314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:39427 every 8 connection(s)
I20260811 15:00:05.135290 32572 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:00:05.143164 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 32572
I20260811 15:00:05.143301 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:00:05.143625 12165 external_mini_cluster.cc:1428] Setting key 55b3ece028b1c9c12c10f7cebbf19929
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:05.150936 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.137590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:58389 (local address 127.11.225.126:33333)
0811 15:00:05.139094 (+ 1504us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.139099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.139118 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:00:05.139872 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.139876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.139936 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.140029 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:05.141191 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.141780 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.143053 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.143408 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.143509 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.146687 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:05.146693 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:05.146699 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:05.146734 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:05.148545 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.149092 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.149097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.149099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.149191 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.149597 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.149601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.149603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.149799 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:05.149914 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.150587 (+ 673us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.150737 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1410}
I20260811 15:00:05.152171 319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.138026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33333 (local address 127.11.225.66:58389)
0811 15:00:05.138552 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.138608 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.139643 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.140220 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.140228 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.140524 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:05.141034 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.141048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.141926 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.141929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.142897 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.142912 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.143739 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.143743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.143953 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.144673 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:05.144695 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:05.146481 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:05.148689 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:05.148694 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:05.148710 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:05.148984 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:05.149319 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:05.149326 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:05.149328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:05.149485 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:05.149912 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:05.149919 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:05.150280 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.150516 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.150897 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":149,"threads_started":1}
I20260811 15:00:05.153921 315 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33333
I20260811 15:00:05.154230 315 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:05.154924 315 heartbeater.cc:511] Master 127.11.225.126:33333 requested a full tablet report, sending...
I20260811 15:00:05.156334 32208 ts_manager.cc:194] Registered new tserver with Master: c4b66dfd141644adac0e435ba2d39022 (127.11.225.66:39427)
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 15:00:05.157274 32208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:58389
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:00:05.185009 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:52523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:38195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
W20260811 15:00:05.363736 325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:05.364208 325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:05.364329 325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:05.370463 325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:05.370645 325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:05.370792 325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:00:05.377919 325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:38195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.225.84:52523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:05.379211 325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:05.380378 325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:05.403069 340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:05.403368 333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:05.405745 335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:05.407269 325 server_base.cc:1034] running on GCE node
I20260811 15:00:05.407953 325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:05.408793 325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:05.412082 325 hybrid_clock.cc:648] HybridClock initialized: now 1786460405411999 us; error 90 us; skew 500 ppm
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:05.416225 325 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:00:05.417510 325 webserver.cc:460] Webserver started at http://127.11.225.67:38461/ using document root <none> and password file <none>
I20260811 15:00:05.418397 325 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:05.418495 325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:05.418753 325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:05.453040 325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "e84d6b24c3534621ae247163e83953f9"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "0d143ad7ab018156a2e4e8b46987ab99"
server_key_iv: "0f849525c174a02b9cdfd8b5f37939e5"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.453866 325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "e84d6b24c3534621ae247163e83953f9"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "0d143ad7ab018156a2e4e8b46987ab99"
server_key_iv: "0f849525c174a02b9cdfd8b5f37939e5"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.465605 325 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.005s sys 0.001s
I20260811 15:00:05.499675 350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.501511 325 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260811 15:00:05.501674 325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "e84d6b24c3534621ae247163e83953f9"
format_stamp: "Formatted at 2026-08-11 15:00:05 on dist-test-slave-8hhm"
server_key: "0d143ad7ab018156a2e4e8b46987ab99"
server_key_iv: "0f849525c174a02b9cdfd8b5f37939e5"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:05.501827 325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:05.521554 325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:05.525758 325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:05.526070 325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:05.526989 325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:05.528272 325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:05.528395 325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.528507 325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:05.528585 325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:05.541548 325 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:41739
I20260811 15:00:05.545166 325 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:00:05.550850 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 325
I20260811 15:00:05.550998 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:00:05.551307 12165 external_mini_cluster.cc:1428] Setting key 273e10fd812bab7c88cec29e43ad81b3
I20260811 15:00:05.547152 536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:41739 every 8 connection(s)
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:05.574014 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.551167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:37295 (local address 127.11.225.126:33333)
0811 15:00:05.551358 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.551363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.554181 (+ 2818us) server_negotiation.cc:407] Connection header received
0811 15:00:05.555620 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.555624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.555681 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.555733 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:05.557632 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.558446 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.560218 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.560569 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.560656 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.564976 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:05.564980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:05.564983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:05.565051 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:05.567827 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.568584 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.568588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.568590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.568686 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.569133 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.569137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.569139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.569412 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:05.569502 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.570298 (+ 796us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.570438 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 15:00:05.576356 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.549829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33333 (local address 127.11.225.67:37295)
0811 15:00:05.554004 (+ 4175us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.554081 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.555352 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.556246 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.556257 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.556663 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:05.557456 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.557479 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.558618 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.558622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.560068 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.560081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.560907 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.560911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.561131 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.562092 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:05.562116 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:05.564066 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:05.568026 (+ 3960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:05.568033 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:05.568054 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:05.568455 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:05.568797 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:05.568800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:05.568802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:05.569002 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:05.569578 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:05.569585 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:05.569969 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.574576 (+ 4607us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.575100 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3915,"thread_start_us":191,"threads_started":1}
I20260811 15:00:05.579499 537 heartbeater.cc:347] Connected to a master server at 127.11.225.126:33333
I20260811 15:00:05.579784 537 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:05.580453 537 heartbeater.cc:511] Master 127.11.225.126:33333 requested a full tablet report, sending...
I20260811 15:00:05.581758 32208 ts_manager.cc:194] Registered new tserver with Master: e84d6b24c3534621ae247163e83953f9 (127.11.225.67:41739)
I20260811 15:00:05.582540 32208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:37295
I20260811 15:00:05.592114 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:00:05.605695 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.594802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57846 (local address 127.11.225.126:33333)
0811 15:00:05.594926 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.594930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.595657 (+ 727us) server_negotiation.cc:407] Connection header received
0811 15:00:05.595866 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.595870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.595925 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.595978 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:05.597075 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.597881 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.599197 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.599532 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.599615 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.601716 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:05.601721 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:05.601723 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:05.601756 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:05.603576 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.604144 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.604148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.604149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.604246 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:05.604578 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:05.604581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:05.604583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:05.604823 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:05.604938 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.605383 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.605520 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:00:05.610570 32208 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:00:05.615716 32208 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:00:05.646049 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.629411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:41739 (local address 127.0.0.1:36108)
0811 15:00:05.634296 (+ 4885us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.634358 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.634493 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.638597 (+ 4104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.638604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.638629 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:05.638769 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.638776 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.640261 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.640265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.642868 (+ 2603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.642881 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.645416 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.645419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.645550 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.645599 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.645721 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.645857 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4688,"thread_start_us":101,"threads_started":1}
I20260811 15:00:05.647073 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.630505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.11.225.67:41739)
0811 15:00:05.635199 (+ 4694us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.635211 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.635237 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:00:05.635320 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.635325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.635560 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.638382 (+ 2822us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:05.638919 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.640118 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.643168 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.644106 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.644224 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.644397 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.646749 (+ 2352us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.646886 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4575,"thread_start_us":134,"threads_started":1}
I20260811 15:00:05.649560 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.632841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44045 (local address 127.0.0.1:53082)
0811 15:00:05.638042 (+ 5201us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.638059 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.638153 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.642367 (+ 4214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.642370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.642388 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:05.642477 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.642482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.643838 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.643842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.644973 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.644986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.649050 (+ 4064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.649055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.649169 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.649199 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.649299 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.649390 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2072,"thread_start_us":84,"threads_started":1}
I20260811 15:00:05.651341 422 tablet_service.cc:1467] Processing CreateTablet for tablet fd869e04860843838850d7dbf4643121 (DEFAULT_TABLE table=test-table [id=4a03a2aaf3c3457b9602bbae4471c829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:05.653843 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.633020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.11.225.65:44045)
0811 15:00:05.641465 (+ 8445us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.641473 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.641503 (+ 30us) server_negotiation.cc:407] Connection header received
0811 15:00:05.641589 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.641596 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.642025 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.642207 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:05.642610 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.643697 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.647683 (+ 3986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.648668 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.648786 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.648955 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.653480 (+ 4525us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.653668 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8313,"thread_start_us":139,"threads_started":1}
I20260811 15:00:05.654785 422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd869e04860843838850d7dbf4643121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:05.658417 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.632455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:39427 (local address 127.0.0.1:33802)
0811 15:00:05.634720 (+ 2265us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.634733 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.634804 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.645873 (+ 11069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.645876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.645895 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:05.646056 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.646063 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.654245 (+ 8182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.654250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.655548 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.655565 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.657943 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.657948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.658088 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.658121 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.658178 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.658259 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2203,"thread_start_us":106,"threads_started":1}
I20260811 15:00:05.659415 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.632659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.11.225.66:39427)
0811 15:00:05.645321 (+ 12662us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.645341 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.645368 (+ 27us) server_negotiation.cc:407] Connection header received
0811 15:00:05.645453 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.645459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.645705 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.646241 (+ 536us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:05.646391 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.647507 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.655767 (+ 8260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.656772 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.658928 (+ 2156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.659123 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.659180 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.659281 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12510,"thread_start_us":129,"threads_started":1}
I20260811 15:00:05.660368 32447 tablet_service.cc:1467] Processing CreateTablet for tablet fd869e04860843838850d7dbf4643121 (DEFAULT_TABLE table=test-table [id=4a03a2aaf3c3457b9602bbae4471c829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:05.661717 32447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd869e04860843838850d7dbf4643121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:05.662447 32648 tablet_service.cc:1467] Processing CreateTablet for tablet fd869e04860843838850d7dbf4643121 (DEFAULT_TABLE table=test-table [id=4a03a2aaf3c3457b9602bbae4471c829]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:05.663617 32648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd869e04860843838850d7dbf4643121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:05.667289 572 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Bootstrap starting.
I20260811 15:00:05.670652 572 tablet_bootstrap.cc:654] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:05.671609 572 log.cc:824] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:05.673938 572 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: No bootstrap required, opened a new log
I20260811 15:00:05.674149 572 ts_tablet_manager.cc:1397] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.002s
I20260811 15:00:05.677723 573 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Bootstrap starting.
I20260811 15:00:05.679603 572 raft_consensus.cc:348] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.680083 572 raft_consensus.cc:374] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:05.680194 572 raft_consensus.cc:729] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e84d6b24c3534621ae247163e83953f9, State: Initialized, Role: FOLLOWER
I20260811 15:00:05.680536 573 tablet_bootstrap.cc:654] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:05.680814 572 consensus_queue.cc:260] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.681715 577 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Bootstrap starting.
I20260811 15:00:05.682073 572 ts_tablet_manager.cc:1428] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
I20260811 15:00:05.682528 537 heartbeater.cc:503] Master 127.11.225.126:33333 was elected leader, sending a full tablet report...
I20260811 15:00:05.684278 577 tablet_bootstrap.cc:654] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:05.685281 577 log.cc:824] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:05.690343 573 log.cc:824] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:05.693053 573 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: No bootstrap required, opened a new log
I20260811 15:00:05.693342 573 ts_tablet_manager.cc:1397] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260811 15:00:05.694684 577 tablet_bootstrap.cc:492] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: No bootstrap required, opened a new log
I20260811 15:00:05.694890 577 ts_tablet_manager.cc:1397] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260811 15:00:05.696928 584 raft_consensus.cc:482] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:00:05.697136 584 raft_consensus.cc:504] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.698478 584 leader_election.cc:288] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cca872ac7ea4052891e388d16cc971c (127.11.225.65:44045), c4b66dfd141644adac0e435ba2d39022 (127.11.225.66:39427)
I20260811 15:00:05.699779 577 raft_consensus.cc:348] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.703802 573 raft_consensus.cc:348] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.704174 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.698846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:39427 (local address 127.11.225.67:34387)
0811 15:00:05.699157 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.699172 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.699273 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.700252 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.700255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.700274 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:05.700389 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.700396 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.701568 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.701572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.702760 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.702772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.703739 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.703743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.703857 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.703881 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.703952 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.704036 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260811 15:00:05.704252 573 raft_consensus.cc:374] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:05.704326 573 raft_consensus.cc:729] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cca872ac7ea4052891e388d16cc971c, State: Initialized, Role: FOLLOWER
I20260811 15:00:05.704898 573 consensus_queue.cc:260] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.705283 577 raft_consensus.cc:374] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:05.705420 577 raft_consensus.cc:729] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b66dfd141644adac0e435ba2d39022, State: Initialized, Role: FOLLOWER
I20260811 15:00:05.706024 577 consensus_queue.cc:260] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.706245 573 ts_tablet_manager.cc:1428] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260811 15:00:05.706547 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.699425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:34387 (local address 127.11.225.66:39427)
0811 15:00:05.699867 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.699872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.699890 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:00:05.699960 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.699964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.700022 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.700112 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:05.700641 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.701428 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.702909 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.703510 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.703625 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.703678 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.705166 (+ 1488us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.705270 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355}
I20260811 15:00:05.706749 32562 heartbeater.cc:503] Master 127.11.225.126:33333 was elected leader, sending a full tablet report...
I20260811 15:00:05.707223 32711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd869e04860843838850d7dbf4643121" candidate_uuid: "e84d6b24c3534621ae247163e83953f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b66dfd141644adac0e435ba2d39022" is_pre_election: true
I20260811 15:00:05.707504 32711 raft_consensus.cc:2454] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e84d6b24c3534621ae247163e83953f9 in term 0.
I20260811 15:00:05.708108 577 ts_tablet_manager.cc:1428] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20260811 15:00:05.708447 315 heartbeater.cc:503] Master 127.11.225.126:33333 was elected leader, sending a full tablet report...
I20260811 15:00:05.708546 351 leader_election.cc:302] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b66dfd141644adac0e435ba2d39022, e84d6b24c3534621ae247163e83953f9; no voters:
I20260811 15:00:05.710078 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.699798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44045 (local address 127.11.225.67:49035)
0811 15:00:05.704336 (+ 4538us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.704351 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.704427 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.705356 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:05.705361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:05.705385 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:05.705479 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.705486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.707119 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.707123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.708196 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:05.708208 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.709693 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.709697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:05.709774 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.709797 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:00:05.709863 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 15:00:05.709925 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4478,"thread_start_us":148,"threads_started":1}
I20260811 15:00:05.710496 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.700273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:49035 (local address 127.11.225.65:44045)
0811 15:00:05.700581 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.700585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.704676 (+ 4091us) server_negotiation.cc:407] Connection header received
0811 15:00:05.704733 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.704736 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.704788 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.704861 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:05.705625 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.706335 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.708843 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.709462 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.709578 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.709632 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.710302 (+ 670us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.710374 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260811 15:00:05.710736 584 raft_consensus.cc:2781] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:00:05.710839 584 raft_consensus.cc:482] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:00:05.710882 584 raft_consensus.cc:3037] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:05.711337 32483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd869e04860843838850d7dbf4643121" candidate_uuid: "e84d6b24c3534621ae247163e83953f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cca872ac7ea4052891e388d16cc971c" is_pre_election: true
I20260811 15:00:05.711618 32483 raft_consensus.cc:2454] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e84d6b24c3534621ae247163e83953f9 in term 0.
I20260811 15:00:05.712435 584 raft_consensus.cc:504] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.712795 584 leader_election.cc:288] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [CANDIDATE]: Term 1 election: Requested vote from peers 7cca872ac7ea4052891e388d16cc971c (127.11.225.65:44045), c4b66dfd141644adac0e435ba2d39022 (127.11.225.66:39427)
I20260811 15:00:05.713357 32483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd869e04860843838850d7dbf4643121" candidate_uuid: "e84d6b24c3534621ae247163e83953f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cca872ac7ea4052891e388d16cc971c"
I20260811 15:00:05.713467 32711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd869e04860843838850d7dbf4643121" candidate_uuid: "e84d6b24c3534621ae247163e83953f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b66dfd141644adac0e435ba2d39022"
I20260811 15:00:05.713505 32483 raft_consensus.cc:3037] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:05.713588 32711 raft_consensus.cc:3037] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:05.714826 32483 raft_consensus.cc:2454] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e84d6b24c3534621ae247163e83953f9 in term 1.
I20260811 15:00:05.714826 32711 raft_consensus.cc:2454] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e84d6b24c3534621ae247163e83953f9 in term 1.
I20260811 15:00:05.715188 351 leader_election.cc:302] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4b66dfd141644adac0e435ba2d39022, e84d6b24c3534621ae247163e83953f9; no voters:
I20260811 15:00:05.715694 584 raft_consensus.cc:2781] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:00:05.715974 584 raft_consensus.cc:686] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 1 LEADER]: Becoming Leader. State: Replica: e84d6b24c3534621ae247163e83953f9, State: Running, Role: LEADER
I20260811 15:00:05.716362 584 consensus_queue.cc:237] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } }
I20260811 15:00:05.720948 32208 catalog_manager.cc:5495] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e84d6b24c3534621ae247163e83953f9 (127.11.225.67). New cstate: current_term: 1 leader_uuid: "e84d6b24c3534621ae247163e83953f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e84d6b24c3534621ae247163e83953f9" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 41739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 } health_report { overall_health: UNKNOWN } } }
I20260811 15:00:05.752285 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.746862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36110 (local address 127.11.225.67:41739)
0811 15:00:05.747011 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:05.747016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:05.747033 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:00:05.747142 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:05.747145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:05.747230 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:05.747353 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:00:05.747845 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.748626 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.749884 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:05.750209 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:05.750323 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:05.750807 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:00:05.751413 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:00:05.751553 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:05.752035 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 15:00:05.752101 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:00:05.762858 32711 raft_consensus.cc:1261] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 1 FOLLOWER]: Refusing update from remote peer e84d6b24c3534621ae247163e83953f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260811 15:00:05.763594 32563 tablet.cc:2369] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:00:05.763762 32483 raft_consensus.cc:1261] T fd869e04860843838850d7dbf4643121 P 7cca872ac7ea4052891e388d16cc971c [term 1 FOLLOWER]: Refusing update from remote peer e84d6b24c3534621ae247163e83953f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:00:05.764814 584 consensus_queue.cc:1035] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cca872ac7ea4052891e388d16cc971c" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 44045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:00:05.765285 584 consensus_queue.cc:1035] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b66dfd141644adac0e435ba2d39022" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:00:05.782599 599 mvcc.cc:205] Tried to move back new op lower bound from 7317341821985136640 to 7317341821822488576. Current Snapshot: MvccSnapshot[applied={T|T < 7317341821985136640}]
I20260811 15:00:05.786460 606 mvcc.cc:205] Tried to move back new op lower bound from 7317341821985136640 to 7317341821822488576. Current Snapshot: MvccSnapshot[applied={T|T < 7317341821985136640}]
Aug 11 15:00:05 dist-test-slave-8hhm krb5kdc[31347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:05.795028 32208 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:00:05.795233 32208 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:00:05.798460 32208 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8d92cee04ad434e9219264d86d7b956: Sending DeleteTablet for 3 replicas of tablet fd869e04860843838850d7dbf4643121
I20260811 15:00:05.799609 32447 tablet_service.cc:1514] Processing DeleteTablet for tablet fd869e04860843838850d7dbf4643121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:05 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:53082
I20260811 15:00:05.799849 32648 tablet_service.cc:1514] Processing DeleteTablet for tablet fd869e04860843838850d7dbf4643121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:05 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:33802
I20260811 15:00:05.806244 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 32337
I20260811 15:00:05.809345 422 tablet_service.cc:1514] Processing DeleteTablet for tablet fd869e04860843838850d7dbf4643121 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:05 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:36108
I20260811 15:00:05.820554 622 tablet_replica.cc:330] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: stopping tablet replica
I20260811 15:00:05.821064 622 raft_consensus.cc:2229] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:00:05.821605 622 raft_consensus.cc:2258] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:00:05.823419 622 ts_tablet_manager.cc:1905] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:00:05.826591 622 ts_tablet_manager.cc:1918] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:00:05.826749 622 log.cc:1196] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/fd869e04860843838850d7dbf4643121
I20260811 15:00:05.827140 622 ts_tablet_manager.cc:1939] T fd869e04860843838850d7dbf4643121 P c4b66dfd141644adac0e435ba2d39022: Deleting consensus metadata
I20260811 15:00:05.828768 32179 catalog_manager.cc:4841] TS c4b66dfd141644adac0e435ba2d39022 (127.11.225.66:39427): tablet fd869e04860843838850d7dbf4643121 (table test-table [id=4a03a2aaf3c3457b9602bbae4471c829]) successfully deleted
W20260811 15:00:05.833874 32184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:44045 (error 108)
I20260811 15:00:05.834977 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 32572
I20260811 15:00:05.849392 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.848935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44045 (local address 127.0.0.1:53090)
0811 15:00:05.849179 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.849284 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
W20260811 15:00:05.850121 32184 catalog_manager.cc:4584] TS 7cca872ac7ea4052891e388d16cc971c (127.11.225.65:44045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fd869e04860843838850d7dbf4643121: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44045: connect: Connection refused (error 111)
I20260811 15:00:05.876346 625 tablet_replica.cc:330] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: stopping tablet replica
I20260811 15:00:05.877787 625 raft_consensus.cc:2229] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:00:05.879784 625 raft_consensus.cc:2258] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:00:05.882468 625 ts_tablet_manager.cc:1905] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:00:05.886255 625 ts_tablet_manager.cc:1918] T fd869e04860843838850d7dbf4643121 P e84d6b24c3534621ae247163e83953f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:00:05.886590 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 325
I20260811 15:00:05.917428 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.916842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44045 (local address 127.0.0.1:53100)
0811 15:00:05.917237 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.917317 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253}
I20260811 15:00:05.923017 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:05.922681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:44045 (local address 127.0.0.1:53106)
0811 15:00:05.922861 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.922917 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:44045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260811 15:00:05.928464 570 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:00:05.927751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:41739 (local address 127.0.0.1:36114)
0811 15:00:05.927925 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:05.927939 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:05.928025 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:05.928327 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.67:41739: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 15:00:05.929162 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 32150
I20260811 15:00:05.958504 12165 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 15:00:06.314193 12165 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 15:00:06.314337 12165 mini_ranger.cc:66] Stopping Ranger...
I20260811 15:00:06.670521 12165 mini_ranger.cc:68] Stopped Ranger
2026-08-11 15:00:06.670 UTC [31408] LOG: received smart shutdown request
2026-08-11 15:00:06.675 UTC [31408] LOG: background worker "logical replication launcher" (PID 31422) exited with exit code 1
2026-08-11 15:00:06.675 UTC [31412] LOG: shutting down
2026-08-11 15:00:06.859 UTC [31408] LOG: database system is shut down
2026-08-11T15:00:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49340 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:00:07 dist-test-slave-8hhm krb5kdc[646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:00:07 dist-test-slave-8hhm krb5kdc[646](info): set up 2 sockets
Aug 11 15:00:07 dist-test-slave-8hhm krb5kdc[646](info): commencing operation
krb5kdc: starting...
W20260811 15:00:08.295879 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:00:08 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:00:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:00:08Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangeradmin_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangeradmin_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangerlookup_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangerlookup_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
I20260811 15:00:08.484120 12165 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasknb3eKX/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/postgres -l logfile start
2026-08-11 15:00:11.074 UTC [692] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 15:00:11.074 UTC [692] LOG: listening on IPv4 address "127.11.225.84", port 41413
2026-08-11 15:00:11.078 UTC [692] LOG: listening on Unix socket "/tmp/.s.PGSQL.41413"
2026-08-11 15:00:11.101 UTC [696] LOG: database system was shut down at 2026-08-11 15:00:09 UTC
2026-08-11 15:00:11.105 UTC [692] LOG: database system is ready to accept connections
I20260811 15:00:12.377205 12165 mini_postgres.cc:96] Postgres bound to 41413
2026-08-11 15:00:12.385 UTC [712] FATAL: database "slave" does not exist
127.11.225.84:41413 - accepting connections
I20260811 15:00:12.385854 12165 mini_ranger.cc:161] Starting Ranger...
I20260811 15:00:12.402132 12165 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 15:00:12.925320 12165 mini_ranger.cc:87] Created ranger Postgres database
I20260811 15:00:12.925407 12165 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin
2026-08-11 15:00:13,197 [I] DB FLAVOR :POSTGRES
2026-08-11 15:00:13,198 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:00:13,198 [I] Checking connection..
2026-08-11 15:00:13,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 15:00:13,472 [I] Checking connection passed.
2026-08-11 15:00:13,472 [I] --------- Verifying version history table ---------
2026-08-11 15:00:13,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:00:13,727 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:00:13,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:00:14,001 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:00:14,001 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 15:00:14,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 15:00:14.269 UTC [831] WARNING: there is no transaction in progress
2026-08-11 15:00:14,277 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 15:00:14,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:00:14,539 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 15:00:14,540 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:00:14,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 15:00:14,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 15:00:15,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8hhm.c.gcp-upstream.internal','N') ;"
2026-08-11 15:00:15,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:00:15,616 [I] Table x_portal_user does not exist in database ranger
2026-08-11 15:00:15,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:00:15,897 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 15:00:15,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:00:16,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:00:16,450 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 15:00:16,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 15:00:17.449 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.465 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.480 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.496 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.511 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.528 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.595 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.603 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.618 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.630 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.641 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.655 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.665 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.672 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.680 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:17.687 UTC [1003] WARNING: there is no transaction in progress
2026-08-11 15:00:18,425 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 15:00:18,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 15:00:18,676 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 15:00:18,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:00:18,937 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 15:00:18,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:00:19,210 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 15:00:19,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:00:19,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:00:19,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8hhm.c.gcp-upstream.internal';"
2026-08-11 15:00:19,989 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 15:00:19,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 15:00:20,257 [I] DB_PATCHES have already been applied
I20260811 15:00:20.263793 12165 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasknb3eKX/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 15:00:20.263885 12165 mini_ranger.cc:193] Using host: 127.11.225.84
I20260811 15:00:20.268909 12165 mini_ranger.cc:227] Ranger admin URL: http://127.11.225.84:54721
Aug 11, 2026 3:00:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:00:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:00:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 3:00:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 3:00:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 3:00:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 3:00:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 15:00:21.681854 12165 mini_ranger.cc:160] Time spent starting Ranger: real 9.296s user 0.002s sys 0.010s
Aug 11, 2026 3:00:42 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 3:00:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 3:00:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 3:00:42 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 3:00:43 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 15:00:43.935652 12165 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.225.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.225.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangerkms_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.225.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/rangerkms_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.225.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.225.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.225.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/HTTP_127.11.225.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 15:00:44 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460444, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 15:00:44.025089 12165 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 15:00:44.035283 12165 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 15:00:44.862150 12165 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 15:00:44.862241 12165 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms
I20260811 15:00:44.862265 12165 mini_ranger_kms.cc:227] Using postgres at 127.11.225.84:41413
2026-08-11 15:00:45,058 [I] DB FLAVOR :POSTGRES
2026-08-11 15:00:45,059 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:00:45,059 [I] Checking connection
2026-08-11 15:00:45,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 15:00:45,299 [I] connection success
2026-08-11 15:00:45,300 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 15:00:45,300 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 15:00:45,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 15:00:45,553 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 15:00:45,553 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:00:45,554 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 15:00:45,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.225.84:41413/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 15:00:45,824 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 15:00:46.286638 12165 mini_ranger_kms.cc:310] Created kms service
I20260811 15:00:46.475175 12165 mini_ranger_kms.cc:326] Created kudu user
I20260811 15:00:46.518844 12165 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 15:00:46 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460444, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:46.929245 12165 mini_ranger_kms.cc:384] Added ranger policy
I20260811 15:00:46.929440 12165 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms:/tmp/dist-test-tasknb3eKX/build/debug/bin/postgresql.jar:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasknb3eKX/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 15:00:46.929466 12165 mini_ranger_kms.cc:240] Using host: 127.11.225.84
I20260811 15:00:46.935102 12165 mini_ranger_kms.cc:276] Ranger KMS PID: 1307
I20260811 15:00:46.935200 12165 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.225.84:41273
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 3:00:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 15:00:49 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460449, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:49.867600 12165 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.843s user 0.009s sys 0.165s
I20260811 15:00:49.867744 12165 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 15:00:49.867841 12165 mini_ranger_kms.cc:401] 127.11.225.84:41273/kms/v1/keys
Aug 11 15:00:50 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460449, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
Aug 11 15:00:50 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460449, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.225.84@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
Aug 11 15:00:52 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:00:52.869609 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45931
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:52.993736 1386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:52.994021 1386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:52.994096 1386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:52.998098 1386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:00:52.998172 1386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:52.998203 1386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:52.998277 1386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:00:52.998322 1386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:00:53.003799 1386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.225.84:41273/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45931
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:53.004933 1386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:53.006084 1386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:53.015125 1396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:53.015151 1391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:53.015151 1392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:53.015714 1386 server_base.cc:1034] running on GCE node
I20260811 15:00:53.016287 1386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:53.017591 1386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:53.018776 1386 hybrid_clock.cc:648] HybridClock initialized: now 1786460453018756 us; error 34 us; skew 500 ppm
Aug 11 15:00:53 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:53.021798 1386 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:00:53.022820 1386 webserver.cc:460] Webserver started at http://127.11.225.126:35223/ using document root <none> and password file <none>
I20260811 15:00:53.023373 1386 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:53.023430 1386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:53.023662 1386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:53 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:53.087050 1386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "ee30ef4972504bdd8bc76e886b466aaa"
format_stamp: "Formatted at 2026-08-11 15:00:53 on dist-test-slave-8hhm"
server_key: "5c5f4797ddcf507b88901874a6f3f548"
server_key_iv: "fae3f8a4a3cd6a380ee902720d28071f"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:53.087716 1386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "ee30ef4972504bdd8bc76e886b466aaa"
format_stamp: "Formatted at 2026-08-11 15:00:53 on dist-test-slave-8hhm"
server_key: "5c5f4797ddcf507b88901874a6f3f548"
server_key_iv: "fae3f8a4a3cd6a380ee902720d28071f"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:53.091828 1386 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:00:53.109146 1410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:53.110710 1386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:00:53.110870 1386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "ee30ef4972504bdd8bc76e886b466aaa"
format_stamp: "Formatted at 2026-08-11 15:00:53 on dist-test-slave-8hhm"
server_key: "5c5f4797ddcf507b88901874a6f3f548"
server_key_iv: "fae3f8a4a3cd6a380ee902720d28071f"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:53.111011 1386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:53.129941 1386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:53.133113 1386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:53.133385 1386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:53.142278 1386 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45931
I20260811 15:00:53.142297 1501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45931 every 8 connection(s)
I20260811 15:00:53.143296 1386 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:00:53.146394 1502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:53.148731 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 1386
I20260811 15:00:53.148845 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:00:53.149158 12165 external_mini_cluster.cc:1428] Setting key 76756dbdf7e57a51a2ba325e8cd9df62
I20260811 15:00:53.153024 1502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Bootstrap starting.
I20260811 15:00:53.155650 1502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:53.156585 1502 log.cc:824] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:53.159067 1502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: No bootstrap required, opened a new log
Aug 11 15:00:53 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:53.163704 1502 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:53.164041 1502 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:53.164111 1502 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee30ef4972504bdd8bc76e886b466aaa, State: Initialized, Role: FOLLOWER
I20260811 15:00:53.164618 1502 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:53.164791 1502 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:00:53.164880 1502 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:00:53.165007 1502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:53.166115 1502 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:53.166486 1502 leader_election.cc:302] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee30ef4972504bdd8bc76e886b466aaa; no voters:
I20260811 15:00:53.166589 1507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:53.150751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57080 (local address 127.11.225.126:45931)
0811 15:00:53.151244 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:53.151265 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:53.151310 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:00:53.152248 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:53.152276 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:53.152721 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:53.153090 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:53.154058 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:53.155541 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:53.156812 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:53.157549 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:53.157705 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:53.160917 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:53.160923 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:53.160940 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:53.160970 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:53.163122 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:53.163637 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:53.163643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:53.163648 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:53.163794 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:53.164124 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:53.164128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:53.164130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:53.164657 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:53.164881 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:53.165350 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 15:00:53.165641 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":148,"threads_started":1}
I20260811 15:00:53.166850 1502 leader_election.cc:288] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:00:53.167361 1512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:00:53.167620 1512 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 LEADER]: Becoming Leader. State: Replica: ee30ef4972504bdd8bc76e886b466aaa, State: Running, Role: LEADER
I20260811 15:00:53.167951 1512 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:53.168260 1502 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:00:53.169319 1512 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee30ef4972504bdd8bc76e886b466aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 15:00:53.169524 1512 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:53.169849 1510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee30ef4972504bdd8bc76e886b466aaa. Latest consensus state: current_term: 1 leader_uuid: "ee30ef4972504bdd8bc76e886b466aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 15:00:53.170015 1510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:53.170744 1502 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:00:53.174202 1527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:00:53.178939 1527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:00:53.186967 1527 catalog_manager.cc:1347] Generated new cluster ID: 3bbd3c9c4b6b4fc09eb79a9fa187c227
I20260811 15:00:53.187117 1527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:00:53.196864 1527 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:00:53.198203 1527 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:00:53.231711 1527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Generated new TSK 0
I20260811 15:00:53.232717 1527 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:00:54.110586 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:54.266652 1585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:54.267035 1585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:54.267099 1585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:54.272828 1585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:54.272897 1585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:54.273000 1585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:00:54.278710 1585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:54.279989 1585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:54.281150 1585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:54.291658 1596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:54.293103 1585 server_base.cc:1034] running on GCE node
W20260811 15:00:54.293437 1597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:54.293581 1599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:54.294166 1585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:54.295002 1585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:54.296223 1585 hybrid_clock.cc:648] HybridClock initialized: now 1786460454296158 us; error 86 us; skew 500 ppm
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:54.300140 1585 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:00:54.301373 1585 webserver.cc:460] Webserver started at http://127.11.225.65:41891/ using document root <none> and password file <none>
I20260811 15:00:54.302165 1585 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:54.302304 1585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:54.302618 1585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:54.327389 1585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "b4a39b7f2e514592bc47dae3a6f341e7"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "f0a7b4822b2d3af949d69e042d888d75"
server_key_iv: "ffa3a8d4dc06e3d24f5365421744b079"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.328294 1585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "b4a39b7f2e514592bc47dae3a6f341e7"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "f0a7b4822b2d3af949d69e042d888d75"
server_key_iv: "ffa3a8d4dc06e3d24f5365421744b079"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.338068 1585 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.001s
I20260811 15:00:54.358145 1615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.359968 1585 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:00:54.360109 1585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "b4a39b7f2e514592bc47dae3a6f341e7"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "f0a7b4822b2d3af949d69e042d888d75"
server_key_iv: "ffa3a8d4dc06e3d24f5365421744b079"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.360253 1585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:54.383644 1585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:54.387457 1585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:54.387732 1585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:54.388526 1585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:54.390054 1585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:54.390154 1585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.390239 1585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:54.390290 1585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.401183 1585 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:41303
I20260811 15:00:54.402545 1585 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:00:54.410604 1835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:41303 every 8 connection(s)
I20260811 15:00:54.411470 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 1585
I20260811 15:00:54.411608 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:00:54.411975 12165 external_mini_cluster.cc:1428] Setting key da8d9ea8010710d363fcb42e07a2a75f
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:54.444809 1842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:54.424571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:59887 (local address 127.11.225.126:45931)
0811 15:00:54.426836 (+ 2265us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:54.426842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:54.426857 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:00:54.426905 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:54.426908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:54.426959 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:54.427056 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:54.428734 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.429684 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.431474 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.431846 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.431930 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:54.437896 (+ 5966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:54.437903 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:54.437910 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:54.437949 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:54.440074 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:54.441648 (+ 1574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:54.441652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:54.441654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:54.441767 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:54.442287 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:54.442291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:54.442293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:54.442558 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:54.442657 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:54.444398 (+ 1741us) server_negotiation.cc:299] Negotiation successful
0811 15:00:54.444577 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2165,"thread_start_us":95,"threads_started":1}
I20260811 15:00:54.457435 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:54.423264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.65:59887)
0811 15:00:54.425039 (+ 1775us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:54.425107 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:54.426348 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:54.427385 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:54.427396 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:54.427791 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:54.428525 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:54.428548 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.429864 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.429868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:54.431321 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:54.431334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.432153 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.432157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:54.432375 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:54.433123 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:54.433150 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:54.437638 (+ 4488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:54.440233 (+ 2595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:54.440241 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:54.440262 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:54.441474 (+ 1212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:54.441906 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:54.441909 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:54.441911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:54.442137 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:54.442736 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:54.442745 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:54.444035 (+ 1290us) client_negotiation.cc:769] Sending connection context
0811 15:00:54.445404 (+ 1369us) client_negotiation.cc:240] Negotiation successful
0811 15:00:54.456119 (+ 10715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1516,"thread_start_us":208,"threads_started":1}
I20260811 15:00:54.459568 1836 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:54.459846 1836 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:54.460503 1836 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:54.462536 1446 ts_manager.cc:194] Registered new tserver with Master: b4a39b7f2e514592bc47dae3a6f341e7 (127.11.225.65:41303)
I20260811 15:00:54.464068 1446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:59887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:00:54.486498 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:54.654318 1845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:54.654809 1845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:54.654942 1845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:54.661382 1845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:54.661603 1845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:54.661772 1845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:00:54.671185 1845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:54.672982 1845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:54.674625 1845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:54.689002 1858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:54.690418 1857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:54.690737 1845 server_base.cc:1034] running on GCE node
W20260811 15:00:54.691586 1862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:54.692201 1845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:54.693092 1845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:54.694466 1845 hybrid_clock.cc:648] HybridClock initialized: now 1786460454694393 us; error 104 us; skew 500 ppm
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:54.698764 1845 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:00:54.700098 1845 webserver.cc:460] Webserver started at http://127.11.225.66:36985/ using document root <none> and password file <none>
I20260811 15:00:54.700948 1845 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:54.701116 1845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:54.701478 1845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:54.725288 1845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "267fb0d823d44d4e8839a9fcffeb126c"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "2a924ce1fba435516d5a8559d43200df"
server_key_iv: "374173313235cbcdbe6fc7b7a8b17197"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.726104 1845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "267fb0d823d44d4e8839a9fcffeb126c"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "2a924ce1fba435516d5a8559d43200df"
server_key_iv: "374173313235cbcdbe6fc7b7a8b17197"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.731326 1845 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260811 15:00:54.759460 1874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.761299 1845 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:00:54.761430 1845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "267fb0d823d44d4e8839a9fcffeb126c"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "2a924ce1fba435516d5a8559d43200df"
server_key_iv: "374173313235cbcdbe6fc7b7a8b17197"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:54.761575 1845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:54.801934 1845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:54.808018 1845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:54.808246 1845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:54.809019 1845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:54.810158 1845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:54.810249 1845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.810323 1845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:54.810380 1845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:54.822842 1845 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35103
I20260811 15:00:54.824479 2080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35103 every 8 connection(s)
I20260811 15:00:54.825382 1845 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:00:54.830399 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 1845
I20260811 15:00:54.830518 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:00:54.830823 12165 external_mini_cluster.cc:1428] Setting key 00b866cbd18e1f7b4770af73fe182af5
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:54.845000 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:54.828005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.66:36597)
0811 15:00:54.829515 (+ 1510us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:54.829572 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:54.830618 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:54.831518 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:54.831527 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:54.831939 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:54.832630 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:54.832651 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.833847 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.833850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:54.835265 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:54.835276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.836120 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.836124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:54.836330 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:54.837092 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:54.837115 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:54.839046 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:54.841351 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:54.841358 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:54.841377 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:54.841780 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:54.842115 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:54.842119 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:54.842121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:54.842324 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:54.842862 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:54.842870 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:54.843226 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 15:00:54.843462 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 15:00:54.843853 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1268,"thread_start_us":166,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 15:00:54.845654 1842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:54.829151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:36597 (local address 127.11.225.126:45931)
0811 15:00:54.829340 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:54.829346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:54.829679 (+ 333us) server_negotiation.cc:407] Connection header received
0811 15:00:54.830871 (+ 1192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:54.830875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:54.830934 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:54.830990 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:54.832804 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.833683 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.835421 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:54.835820 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:54.835941 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:54.839261 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:54.839266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:54.839268 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:54.839298 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:54.841185 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:54.841906 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:54.841910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:54.841912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:54.842005 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:54.842437 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:54.842440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:54.842442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:54.842697 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:54.842798 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:54.845318 (+ 2520us) server_negotiation.cc:299] Negotiation successful
0811 15:00:54.845471 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:00:54.847354 2081 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:54.847623 2081 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:54.848263 2081 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:54.849614 1446 ts_manager.cc:194] Registered new tserver with Master: 267fb0d823d44d4e8839a9fcffeb126c (127.11.225.66:35103)
I20260811 15:00:54.850392 1446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:36597
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:00:54.885847 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:00:54 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
W20260811 15:00:55.055063 2086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:55.055476 2086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:55.055537 2086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:55.061690 2086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:55.061785 2086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:55.061870 2086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:00:55.070163 2086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:55.071671 2086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:55.073063 2086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:55.086622 2100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:55.086638 2094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:55.087085 2086 server_base.cc:1034] running on GCE node
W20260811 15:00:55.087083 2096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:55.087809 2086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:55.088604 2086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:55.089763 2086 hybrid_clock.cc:648] HybridClock initialized: now 1786460455089691 us; error 88 us; skew 500 ppm
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:55.093612 2086 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:00:55.094795 2086 webserver.cc:460] Webserver started at http://127.11.225.67:35799/ using document root <none> and password file <none>
I20260811 15:00:55.095515 2086 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:55.095597 2086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:00:55.095813 2086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:55.112020 2086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "110115b8294640c9b74d02fa024f8aaf"
format_stamp: "Formatted at 2026-08-11 15:00:55 on dist-test-slave-8hhm"
server_key: "abb58e0418f69946d757eec3b42ffb83"
server_key_iv: "2ff74b26daea58581bc0108558ce65ab"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:55.113554 2086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "110115b8294640c9b74d02fa024f8aaf"
format_stamp: "Formatted at 2026-08-11 15:00:55 on dist-test-slave-8hhm"
server_key: "abb58e0418f69946d757eec3b42ffb83"
server_key_iv: "2ff74b26daea58581bc0108558ce65ab"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:55.124728 2086 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.004s sys 0.000s
I20260811 15:00:55.153699 2115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.155633 2086 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.002s sys 0.000s
I20260811 15:00:55.155778 2086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "110115b8294640c9b74d02fa024f8aaf"
format_stamp: "Formatted at 2026-08-11 15:00:55 on dist-test-slave-8hhm"
server_key: "abb58e0418f69946d757eec3b42ffb83"
server_key_iv: "2ff74b26daea58581bc0108558ce65ab"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:55.155928 2086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:55.189041 2086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:55.192993 2086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:55.193293 2086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:55.194017 2086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:55.195149 2086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:55.195261 2086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.195354 2086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:55.195411 2086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.206900 2086 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37875
I20260811 15:00:55.208204 2086 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:00:55.209496 2317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37875 every 8 connection(s)
I20260811 15:00:55.213084 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 2086
I20260811 15:00:55.213248 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:00:55.213562 12165 external_mini_cluster.cc:1428] Setting key 819fa42e32dcb36cfd7dc4e99e05d1a9
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:55.225844 1842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:55.210619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:39641 (local address 127.11.225.126:45931)
0811 15:00:55.210749 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:55.210753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:55.211724 (+ 971us) server_negotiation.cc:407] Connection header received
0811 15:00:55.212988 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:55.212992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:55.213065 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:55.213123 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:55.215363 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.216185 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.217851 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.218187 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.218261 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:55.221217 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:55.221220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:55.221260 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:55.221288 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:55.223104 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:55.223778 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:55.223782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:55.223784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:55.223875 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:55.224292 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:55.224296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:55.224297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:55.224513 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:55.224582 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:55.225549 (+ 967us) server_negotiation.cc:299] Negotiation successful
0811 15:00:55.225684 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:00:55.227752 2320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:55.211077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.67:39641)
0811 15:00:55.211554 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:55.211606 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:55.212730 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:55.213603 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:55.213613 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:55.214368 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:55.215188 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:55.215215 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.216374 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.216377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:55.217720 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:55.217731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.218478 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.218482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:55.218667 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:55.219357 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:55.219377 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:55.221005 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:55.223250 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:55.223257 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:55.223277 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:55.223632 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:55.223988 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:55.223991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:55.223993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:55.224191 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:55.224662 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:55.224669 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:55.225244 (+ 575us) client_negotiation.cc:769] Sending connection context
0811 15:00:55.226308 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0811 15:00:55.226655 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":146,"threads_started":1}
I20260811 15:00:55.229285 2318 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:55.229573 2318 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:55.230242 2318 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:55.231459 1446 ts_manager.cc:194] Registered new tserver with Master: 110115b8294640c9b74d02fa024f8aaf (127.11.225.67:37875)
I20260811 15:00:55.232272 1446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:39641
I20260811 15:00:55.239652 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:00:55.240648 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 1585
I20260811 15:00:55.256726 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 1845
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460454, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:55.276351 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 2086
I20260811 15:00:55.304632 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 1386
I20260811 15:00:55.330212 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--webserver_interface=127.11.225.126
--webserver_port=35223
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45931
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:00:55.476964 2323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:55.477322 2323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:55.477392 2323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:55.481484 2323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:00:55.481536 2323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:55.481555 2323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:55.481590 2323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:00:55.481623 2323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:00:55.486867 2323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45931
--ranger_config_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=35223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:55.487931 2323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:55.489073 2323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:55.498940 2336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:55.498951 2335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:55.499082 2340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:55.499967 2323 server_base.cc:1034] running on GCE node
I20260811 15:00:55.500602 2323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:55.501883 2323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:55.503104 2323 hybrid_clock.cc:648] HybridClock initialized: now 1786460455503072 us; error 43 us; skew 500 ppm
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:55.506196 2323 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:00:55.507109 2323 webserver.cc:460] Webserver started at http://127.11.225.126:35223/ using document root <none> and password file <none>
I20260811 15:00:55.507685 2323 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:55.507822 2323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:55.586483 2323 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:00:55.589653 2352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.591439 2323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 15:00:55.591612 2323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "ee30ef4972504bdd8bc76e886b466aaa"
format_stamp: "Formatted at 2026-08-11 15:00:53 on dist-test-slave-8hhm"
server_key: "5c5f4797ddcf507b88901874a6f3f548"
server_key_iv: "fae3f8a4a3cd6a380ee902720d28071f"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:55.592463 2323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:55.636992 2323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:55.640913 2323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:55.641182 2323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:55.651286 2323 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45931
I20260811 15:00:55.651304 2433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45931 every 8 connection(s)
I20260811 15:00:55.652707 2323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:00:55.657929 2434 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:00:55.659847 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Bootstrap starting.
I20260811 15:00:55.661803 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 2323
I20260811 15:00:55.662297 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:41303
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:45931
--webserver_port=41891
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:00:55.684587 2434 log.cc:824] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:55.694406 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:00:55.694900 2434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Bootstrap complete.
I20260811 15:00:55.700522 2434 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:55.701033 2434 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee30ef4972504bdd8bc76e886b466aaa, State: Initialized, Role: FOLLOWER
I20260811 15:00:55.701628 2434 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:55.701808 2434 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:00:55.701892 2434 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:00:55.702000 2434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:00:55.704589 2434 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:55.704957 2434 leader_election.cc:302] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee30ef4972504bdd8bc76e886b466aaa; no voters:
I20260811 15:00:55.705355 2434 leader_election.cc:288] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:00:55.705577 2442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:00:55.705838 2442 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [term 2 LEADER]: Becoming Leader. State: Replica: ee30ef4972504bdd8bc76e886b466aaa, State: Running, Role: LEADER
I20260811 15:00:55.706210 2442 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } }
I20260811 15:00:55.706673 2434 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:00:55.707417 2442 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ee30ef4972504bdd8bc76e886b466aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 15:00:55.707605 2442 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:55.707852 2442 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee30ef4972504bdd8bc76e886b466aaa. Latest consensus state: current_term: 2 leader_uuid: "ee30ef4972504bdd8bc76e886b466aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee30ef4972504bdd8bc76e886b466aaa" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45931 } } }
I20260811 15:00:55.707979 2442 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa [sys.catalog]: This master's current role is: LEADER
I20260811 15:00:55.708256 2460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:00:55.711674 2460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:00:55.712216 2434 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:00:55.712440 2460 catalog_manager.cc:1259] Loaded cluster ID: 3bbd3c9c4b6b4fc09eb79a9fa187c227
I20260811 15:00:55.712550 2460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:00:55.714915 2460 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:00:55.715632 2460 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Loaded TSK: 0
I20260811 15:00:55.716852 2460 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:00:55.833153 2437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:55.833544 2437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:55.833628 2437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:55.840036 2437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:55.840116 2437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:55.840204 2437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:00:55.848274 2437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:41303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=41891
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:55.849704 2437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:55.851078 2437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:55.864945 2501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:55.865409 2437 server_base.cc:1034] running on GCE node
W20260811 15:00:55.865604 2505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:55.865804 2502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:55.866420 2437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:55.867342 2437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:55.868510 2437 hybrid_clock.cc:648] HybridClock initialized: now 1786460455868469 us; error 55 us; skew 500 ppm
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:55.872437 2437 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:00:55.873699 2437 webserver.cc:460] Webserver started at http://127.11.225.65:41891/ using document root <none> and password file <none>
I20260811 15:00:55.874454 2437 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:55.874634 2437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:55.898082 2437 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260811 15:00:55.901612 2519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.903174 2437 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 15:00:55.903290 2437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "b4a39b7f2e514592bc47dae3a6f341e7"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "f0a7b4822b2d3af949d69e042d888d75"
server_key_iv: "ffa3a8d4dc06e3d24f5365421744b079"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:55.903980 2437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:55.929164 2437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:55.933180 2437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:55.933480 2437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:55.934197 2437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:55.935351 2437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:55.935456 2437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.935534 2437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:55.935567 2437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:55.948273 2437 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:41303
I20260811 15:00:55.948305 2732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:41303 every 8 connection(s)
I20260811 15:00:55.949734 2437 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:00:55.957939 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 2437
I20260811 15:00:55.958451 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:35103
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:45931
--webserver_port=36985
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:00:55 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460455, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:55.986310 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:55.964822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.65:32799)
0811 15:00:55.967333 (+ 2511us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:55.967395 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:55.968730 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:55.971340 (+ 2610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:55.971351 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:55.971762 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:55.972521 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:55.972549 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.974554 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.974558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:55.975930 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:55.975941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.977182 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.977186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:55.977395 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:55.978113 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:55.978134 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:55.980047 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:55.982635 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:55.982641 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:55.982655 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:55.982989 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:55.983408 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:55.983411 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:55.983413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:55.983591 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:55.984388 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:55.984394 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:55.984692 (+ 298us) client_negotiation.cc:769] Sending connection context
0811 15:00:55.984885 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 15:00:55.985251 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2210,"thread_start_us":179,"threads_started":1}
I20260811 15:00:55.988240 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:55.966529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:32799 (local address 127.11.225.126:45931)
0811 15:00:55.969346 (+ 2817us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:55.969372 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:55.969424 (+ 52us) server_negotiation.cc:407] Connection header received
0811 15:00:55.969759 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:55.969778 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:55.970251 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:55.970643 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:55.972754 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.974397 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.976073 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:55.976793 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:55.976950 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:55.980308 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:55.980318 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:55.980340 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:55.980375 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:55.982502 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:55.983135 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:55.983143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:55.983150 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:55.983296 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:55.983710 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:55.983713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:55.983715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:55.984194 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:55.984315 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:55.986950 (+ 2635us) server_negotiation.cc:299] Negotiation successful
0811 15:00:55.987297 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2598,"thread_start_us":129,"threads_started":1}
I20260811 15:00:55.991792 2733 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:55.992025 2733 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:55.992589 2733 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:55.995007 2733 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:45931 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:00:55.995136 2733 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:55.995290 2733 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:55.996188 2733 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:55.996353 2733 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:55.997156 2733 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:00:56.131448 2735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:56.131847 2735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:56.131973 2735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:56.138233 2735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:56.138320 2735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:56.138410 2735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:00:56.146560 2735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:35103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=36985
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:56.148026 2735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:56.149528 2735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:56.161878 2751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:56.162045 2752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:56.162447 2756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:56.162957 2735 server_base.cc:1034] running on GCE node
I20260811 15:00:56.163450 2735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:56.164248 2735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:56.165445 2735 hybrid_clock.cc:648] HybridClock initialized: now 1786460456165394 us; error 65 us; skew 500 ppm
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:56.169157 2735 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:00:56.170326 2735 webserver.cc:460] Webserver started at http://127.11.225.66:36985/ using document root <none> and password file <none>
I20260811 15:00:56.171064 2735 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:56.171177 2735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:56.190822 2735 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:00:56.193612 2769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.195067 2735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:00:56.195171 2735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "267fb0d823d44d4e8839a9fcffeb126c"
format_stamp: "Formatted at 2026-08-11 15:00:54 on dist-test-slave-8hhm"
server_key: "2a924ce1fba435516d5a8559d43200df"
server_key_iv: "374173313235cbcdbe6fc7b7a8b17197"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:56.195815 2735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:56.217347 2735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:56.220760 2735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:56.220974 2735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:56.221699 2735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:56.222632 2735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:56.222703 2735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.222776 2735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:56.222828 2735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.234155 2735 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35103
I20260811 15:00:56.235239 2735 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:00:56.238598 2958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35103 every 8 connection(s)
I20260811 15:00:56.241153 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 2735
I20260811 15:00:56.241657 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.225.84:41273/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:37875
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:45931
--webserver_port=35799
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:56.254491 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:56.240968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49439 (local address 127.11.225.126:45931)
0811 15:00:56.241098 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:56.241103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:56.241121 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:00:56.241913 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:56.241920 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:56.241994 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:56.242066 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:56.243843 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.244411 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.245891 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.246284 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.246376 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:56.249514 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:56.249520 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:56.249526 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:56.249563 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:56.251534 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.252271 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.252276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.252279 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.252378 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.252847 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.252854 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.252856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.253145 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:56.253266 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:56.254067 (+ 801us) server_negotiation.cc:299] Negotiation successful
0811 15:00:56.254242 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:00:56.256682 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:56.239767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.66:49439)
0811 15:00:56.240370 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:56.240432 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:56.241637 (+ 1205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:56.242505 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:56.242516 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:56.242888 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:56.243636 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:56.243661 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.244554 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.244556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:56.245729 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:56.245744 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.246606 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.246612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:56.246842 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:56.247567 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:56.247594 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:56.249281 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:56.251683 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:56.251692 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:56.251725 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:56.252135 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:56.252508 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:56.252512 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:56.252514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:56.252720 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:56.253348 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:56.253357 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:56.253726 (+ 369us) client_negotiation.cc:769] Sending connection context
0811 15:00:56.255007 (+ 1281us) client_negotiation.cc:240] Negotiation successful
0811 15:00:56.255423 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":153,"threads_started":1}
I20260811 15:00:56.258477 2959 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:56.258757 2959 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.259352 2959 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:56.261030 2959 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:45931 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:00:56.261160 2959 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.261364 2959 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:56.262172 2959 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.262327 2959 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:56.263049 2959 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:00:56.389945 2965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:00:56.390278 2965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:00:56.390379 2965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:00:56.394932 2965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:00:56.395007 2965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:00:56.395133 2965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:00:56.401784 2965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.225.84:41273/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:37875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=35799
--tserver_master_addrs=127.11.225.126:45931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:00:56.403043 2965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:00:56.404204 2965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:00:56.419939 2981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:56.419946 2976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:00:56.419943 2975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:00:56.420760 2965 server_base.cc:1034] running on GCE node
I20260811 15:00:56.421198 2965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:00:56.421947 2965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:00:56.423158 2965 hybrid_clock.cc:648] HybridClock initialized: now 1786460456423136 us; error 38 us; skew 500 ppm
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:56.426548 2965 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:00:56.427623 2965 webserver.cc:460] Webserver started at http://127.11.225.67:35799/ using document root <none> and password file <none>
I20260811 15:00:56.428375 2965 fs_manager.cc:359] Metadata directory not provided
I20260811 15:00:56.428491 2965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:56.452931 2965 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 15:00:56.456444 2998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.460031 2965 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260811 15:00:56.460183 2965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "110115b8294640c9b74d02fa024f8aaf"
format_stamp: "Formatted at 2026-08-11 15:00:55 on dist-test-slave-8hhm"
server_key: "abb58e0418f69946d757eec3b42ffb83"
server_key_iv: "2ff74b26daea58581bc0108558ce65ab"
server_key_version: "kuduclusterkey@0"
I20260811 15:00:56.460973 2965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:00:56.480835 2965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:00:56.484789 2965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:00:56.485018 2965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:00:56.485852 2965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:00:56.486994 2965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:00:56.487062 2965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.487123 2965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:00:56.487156 2965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:00:56.498809 2965 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37875
I20260811 15:00:56.500262 3193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37875 every 8 connection(s)
I20260811 15:00:56.500397 2965 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:00:56.505059 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 2965
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:00:56.516412 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:56.505809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.11.225.126:45931)
0811 15:00:56.506040 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:56.506049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:56.506221 (+ 172us) server_negotiation.cc:407] Connection header received
0811 15:00:56.506375 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:56.506378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:56.506425 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:56.506529 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:56.507260 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.507900 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.509012 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.509318 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.509426 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:56.511264 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:56.511269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:56.511271 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:56.511303 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:56.512776 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.513424 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.513428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.513430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.513569 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.513923 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.513927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.513929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.514174 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:56.514390 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:56.516031 (+ 1641us) server_negotiation.cc:299] Negotiation successful
0811 15:00:56.516225 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260811 15:00:56.517086 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:56.502509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:48835 (local address 127.11.225.126:45931)
0811 15:00:56.502650 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:56.502654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:56.503656 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 15:00:56.504799 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:56.504803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:56.504866 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:56.504926 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:56.506711 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.507565 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.509286 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.509590 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.509664 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:56.512776 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:56.512780 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:56.512783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:56.512807 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:56.514768 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.515384 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.515406 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.515410 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.515520 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:56.515938 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:56.515940 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:56.515941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:56.516124 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:56.516235 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:56.516810 (+ 575us) server_negotiation.cc:299] Negotiation successful
0811 15:00:56.516953 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":59}
I20260811 15:00:56.518549 3196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:56.502925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45931 (local address 127.11.225.67:48835)
0811 15:00:56.503450 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:56.503552 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:56.504527 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:56.505394 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:56.505404 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:56.505798 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:00:56.506521 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:56.506544 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.507731 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.507734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:56.509129 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:56.509140 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:56.509755 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:56.509762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:56.509967 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:56.510667 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:00:56.510699 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:00:56.512595 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:00:56.514885 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:56.514891 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:56.514908 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:56.515263 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:56.515642 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:00:56.515645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:00:56.515647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:00:56.515831 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:00:56.516237 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:00:56.516246 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:00:56.516526 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 15:00:56.517333 (+ 807us) client_negotiation.cc:240] Negotiation successful
0811 15:00:56.517701 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":146,"threads_started":1}
I20260811 15:00:56.519706 3194 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45931
I20260811 15:00:56.519976 3194 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.520589 3194 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:56.522368 3194 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:45931 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:00:56.522536 3194 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.522728 3194 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:56.523699 3194 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.523891 3194 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
W20260811 15:00:56.524705 3194 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 15:00:56 dist-test-slave-8hhm krb5kdc[646](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:00:56.997413 2733 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:56.997783 2733 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:56.999102 2378 ts_manager.cc:194] Registered new tserver with Master: b4a39b7f2e514592bc47dae3a6f341e7 (127.11.225.65:41303)
I20260811 15:00:57.000885 2378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:32799
I20260811 15:00:57.263269 2959 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:57.263628 2959 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:57.264503 2378 ts_manager.cc:194] Registered new tserver with Master: 267fb0d823d44d4e8839a9fcffeb126c (127.11.225.66:35103)
I20260811 15:00:57.265352 2378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:49439
Aug 11 15:00:57 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:57.524972 3194 heartbeater.cc:464] Registering TS with master...
I20260811 15:00:57.525327 3194 heartbeater.cc:511] Master 127.11.225.126:45931 requested a full tablet report, sending...
I20260811 15:00:57.526170 2378 ts_manager.cc:194] Registered new tserver with Master: 110115b8294640c9b74d02fa024f8aaf (127.11.225.67:37875)
I20260811 15:00:57.526988 2378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:48835
I20260811 15:00:57.532186 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:00:57.547434 3231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.533875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57102 (local address 127.11.225.126:45931)
0811 15:00:57.534114 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.534119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.534370 (+ 251us) server_negotiation.cc:407] Connection header received
0811 15:00:57.534467 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.534471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.534525 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.534621 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:00:57.535425 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.536285 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.537483 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.537834 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.537928 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.543427 (+ 5499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:00:57.543431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:00:57.543434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:00:57.543464 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:00:57.545504 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:57.546012 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:57.546015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:57.546019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:57.546117 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:00:57.546427 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:00:57.546430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:00:57.546432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:00:57.546681 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:00:57.546816 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.547095 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.547233 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
I20260811 15:00:57.552161 2378 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:00:57.556977 2378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:00:57.579458 3245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.569315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41303 (local address 127.0.0.1:42054)
0811 15:00:57.572662 (+ 3347us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.572716 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.572870 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.574134 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:57.574140 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:57.574165 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:57.574300 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.574308 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.575732 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.575736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.577326 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.577338 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.578569 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.578573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.579050 (+ 477us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.579099 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 15:00:57.579204 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 15:00:57.579315 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3170,"thread_start_us":109,"threads_started":1}
I20260811 15:00:57.580063 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.570054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42054 (local address 127.11.225.65:41303)
0811 15:00:57.570409 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.570416 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.573248 (+ 2832us) server_negotiation.cc:407] Connection header received
0811 15:00:57.573338 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.573344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.573579 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.573727 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:57.574439 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.575594 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.577459 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.578250 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.578357 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.578505 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.579820 (+ 1315us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.579927 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":133,"threads_started":1}
I20260811 15:00:57.583920 3241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.571120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35103 (local address 127.0.0.1:35986)
0811 15:00:57.577569 (+ 6449us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.577582 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.577670 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.578406 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:57.578412 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:57.578430 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:57.578516 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.578523 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.580421 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.580424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.581619 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.581632 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.583543 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.583547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.583630 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.583652 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:00:57.583719 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 15:00:57.583782 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6384,"thread_start_us":120,"threads_started":1}
I20260811 15:00:57.584364 3248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.571998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35986 (local address 127.11.225.66:35103)
0811 15:00:57.574035 (+ 2037us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.574043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.577767 (+ 3724us) server_negotiation.cc:407] Connection header received
0811 15:00:57.577848 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.577853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.578070 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.578228 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:57.578655 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.580271 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.581769 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.583244 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.583342 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.583480 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.584133 (+ 653us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.584237 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1914,"thread_start_us":110,"threads_started":1}
I20260811 15:00:57.584184 2613 tablet_service.cc:1467] Processing CreateTablet for tablet e22adae87b20476e93ca097092d42f85 (DEFAULT_TABLE table=test-table [id=e776d228e6bf4ab19478118cd0f74de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:57.585384 2613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22adae87b20476e93ca097092d42f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:57.587196 2844 tablet_service.cc:1467] Processing CreateTablet for tablet e22adae87b20476e93ca097092d42f85 (DEFAULT_TABLE table=test-table [id=e776d228e6bf4ab19478118cd0f74de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:57.588204 2844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22adae87b20476e93ca097092d42f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:57.600004 3245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.571359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37875 (local address 127.0.0.1:41118)
0811 15:00:57.581534 (+ 10175us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.581548 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.581636 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.582295 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:57.582298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:57.582315 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:57.582381 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.582387 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.583754 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.583758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.598050 (+ 14292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.598064 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.599547 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.599551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.599657 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.599682 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:00:57.599757 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 15:00:57.599857 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10122,"thread_start_us":93,"threads_started":1}
I20260811 15:00:57.600643 3247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.571633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41118 (local address 127.11.225.67:37875)
0811 15:00:57.571979 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.571987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.581739 (+ 9752us) server_negotiation.cc:407] Connection header received
0811 15:00:57.581823 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.581828 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.582016 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.582152 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:57.582500 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.583628 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.598260 (+ 14632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.599220 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.599331 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.599478 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.600344 (+ 866us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.600494 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":108,"threads_started":1}
I20260811 15:00:57.602262 3251 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Bootstrap starting.
I20260811 15:00:57.604022 3053 tablet_service.cc:1467] Processing CreateTablet for tablet e22adae87b20476e93ca097092d42f85 (DEFAULT_TABLE table=test-table [id=e776d228e6bf4ab19478118cd0f74de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:00:57.605149 3053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22adae87b20476e93ca097092d42f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:00:57.605546 3252 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Bootstrap starting.
I20260811 15:00:57.607859 3252 tablet_bootstrap.cc:654] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:57.609162 3251 tablet_bootstrap.cc:654] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:57.609714 3252 log.cc:824] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:57.610117 3251 log.cc:824] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:57.612514 3252 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: No bootstrap required, opened a new log
I20260811 15:00:57.612514 3251 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: No bootstrap required, opened a new log
I20260811 15:00:57.612715 3252 ts_tablet_manager.cc:1397] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:00:57.612715 3251 ts_tablet_manager.cc:1397] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260811 15:00:57.616017 3258 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Bootstrap starting.
I20260811 15:00:57.616725 3252 raft_consensus.cc:348] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.616725 3251 raft_consensus.cc:348] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.616988 3251 raft_consensus.cc:374] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:57.616999 3252 raft_consensus.cc:374] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:57.617048 3252 raft_consensus.cc:729] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a39b7f2e514592bc47dae3a6f341e7, State: Initialized, Role: FOLLOWER
I20260811 15:00:57.617058 3251 raft_consensus.cc:729] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 267fb0d823d44d4e8839a9fcffeb126c, State: Initialized, Role: FOLLOWER
I20260811 15:00:57.617903 3251 consensus_queue.cc:260] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.619764 3258 tablet_bootstrap.cc:654] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Neither blocks nor log segments found. Creating new log.
I20260811 15:00:57.620618 3258 log.cc:824] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:00:57.621311 3252 consensus_queue.cc:260] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.622042 2733 heartbeater.cc:503] Master 127.11.225.126:45931 was elected leader, sending a full tablet report...
I20260811 15:00:57.622453 3252 ts_tablet_manager.cc:1428] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260811 15:00:57.623679 3251 ts_tablet_manager.cc:1428] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260811 15:00:57.624061 2959 heartbeater.cc:503] Master 127.11.225.126:45931 was elected leader, sending a full tablet report...
I20260811 15:00:57.636535 3258 tablet_bootstrap.cc:492] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: No bootstrap required, opened a new log
I20260811 15:00:57.636873 3258 ts_tablet_manager.cc:1397] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260811 15:00:57.640653 3258 raft_consensus.cc:348] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.640950 3258 raft_consensus.cc:374] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:00:57.641052 3258 raft_consensus.cc:729] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 110115b8294640c9b74d02fa024f8aaf, State: Initialized, Role: FOLLOWER
I20260811 15:00:57.641696 3258 consensus_queue.cc:260] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
Aug 11 15:00:57 dist-test-slave-8hhm krb5kdc[646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for HTTP/127.11.225.84@KRBTEST.COM
I20260811 15:00:57.643030 3258 ts_tablet_manager.cc:1428] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:00:57.643723 3194 heartbeater.cc:503] Master 127.11.225.126:45931 was elected leader, sending a full tablet report...
I20260811 15:00:57.691108 3264 raft_consensus.cc:482] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:00:57.691380 3264 raft_consensus.cc:504] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.693025 3264 leader_election.cc:288] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a39b7f2e514592bc47dae3a6f341e7 (127.11.225.65:41303), 267fb0d823d44d4e8839a9fcffeb126c (127.11.225.66:35103)
I20260811 15:00:57.709519 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.694718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:60631 (local address 127.11.225.65:41303)
0811 15:00:57.694858 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.694863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.700369 (+ 5506us) server_negotiation.cc:407] Connection header received
0811 15:00:57.700616 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.700620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.700672 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.700722 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:57.701726 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.702515 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.707100 (+ 4585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.707767 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.707873 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.707933 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.709279 (+ 1346us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.709363 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:00:57.710589 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.693534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41303 (local address 127.11.225.67:60631)
0811 15:00:57.700264 (+ 6730us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.700282 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.700460 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.700871 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:57.700874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:57.700892 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:57.701067 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.701075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.702675 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.702679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.703985 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.703999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.708092 (+ 4093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.708096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.708202 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.708228 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:00:57.710339 (+ 2111us) client_negotiation.cc:240] Negotiation successful
0811 15:00:57.710413 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6609,"thread_start_us":123,"threads_started":1}
I20260811 15:00:57.711102 3248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.694911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:46347 (local address 127.11.225.66:35103)
0811 15:00:57.695089 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.695094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.701524 (+ 6430us) server_negotiation.cc:407] Connection header received
0811 15:00:57.704169 (+ 2645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.704173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.704232 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.704282 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:00:57.704716 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.705501 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.708362 (+ 2861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.708973 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.709071 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.709118 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.710896 (+ 1778us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.710983 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:00:57.711685 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.693981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35103 (local address 127.11.225.67:46347)
0811 15:00:57.701411 (+ 7430us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.701429 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.701595 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.704429 (+ 2834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:00:57.704432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:00:57.704451 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:00:57.704570 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.704577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.705655 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.705658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.706939 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:00:57.706951 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.710060 (+ 3109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.710063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:00:57.710167 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.710188 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:00:57.711463 (+ 1275us) client_negotiation.cc:240] Negotiation successful
0811 15:00:57.711548 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7356,"thread_start_us":86,"threads_started":1}
I20260811 15:00:57.712435 2647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22adae87b20476e93ca097092d42f85" candidate_uuid: "110115b8294640c9b74d02fa024f8aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" is_pre_election: true
I20260811 15:00:57.712821 2647 raft_consensus.cc:2454] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 110115b8294640c9b74d02fa024f8aaf in term 0.
I20260811 15:00:57.712877 2881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22adae87b20476e93ca097092d42f85" candidate_uuid: "110115b8294640c9b74d02fa024f8aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "267fb0d823d44d4e8839a9fcffeb126c" is_pre_election: true
I20260811 15:00:57.713177 2881 raft_consensus.cc:2454] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 110115b8294640c9b74d02fa024f8aaf in term 0.
W20260811 15:00:57.713799 2734 tablet.cc:2369] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:00:57.714753 3001 leader_election.cc:302] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 110115b8294640c9b74d02fa024f8aaf, b4a39b7f2e514592bc47dae3a6f341e7; no voters:
I20260811 15:00:57.715114 3264 raft_consensus.cc:2781] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:00:57.715205 3264 raft_consensus.cc:482] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:00:57.715252 3264 raft_consensus.cc:3037] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:57.716719 3264 raft_consensus.cc:504] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.717132 3264 leader_election.cc:288] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [CANDIDATE]: Term 1 election: Requested vote from peers b4a39b7f2e514592bc47dae3a6f341e7 (127.11.225.65:41303), 267fb0d823d44d4e8839a9fcffeb126c (127.11.225.66:35103)
I20260811 15:00:57.718109 2881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22adae87b20476e93ca097092d42f85" candidate_uuid: "110115b8294640c9b74d02fa024f8aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "267fb0d823d44d4e8839a9fcffeb126c"
I20260811 15:00:57.718237 2881 raft_consensus.cc:3037] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:57.719551 2881 raft_consensus.cc:2454] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 110115b8294640c9b74d02fa024f8aaf in term 1.
I20260811 15:00:57.720217 2647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22adae87b20476e93ca097092d42f85" candidate_uuid: "110115b8294640c9b74d02fa024f8aaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a39b7f2e514592bc47dae3a6f341e7"
I20260811 15:00:57.720348 2647 raft_consensus.cc:3037] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:00:57.721714 2647 raft_consensus.cc:2454] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 110115b8294640c9b74d02fa024f8aaf in term 1.
I20260811 15:00:57.722131 2999 leader_election.cc:302] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 110115b8294640c9b74d02fa024f8aaf, 267fb0d823d44d4e8839a9fcffeb126c; no voters:
I20260811 15:00:57.722532 3264 raft_consensus.cc:2781] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:00:57.722780 3264 raft_consensus.cc:686] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 1 LEADER]: Becoming Leader. State: Replica: 110115b8294640c9b74d02fa024f8aaf, State: Running, Role: LEADER
I20260811 15:00:57.723150 3264 consensus_queue.cc:237] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } }
I20260811 15:00:57.727178 2378 catalog_manager.cc:5495] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 110115b8294640c9b74d02fa024f8aaf (127.11.225.67). New cstate: current_term: 1 leader_uuid: "110115b8294640c9b74d02fa024f8aaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "110115b8294640c9b74d02fa024f8aaf" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37875 } health_report { overall_health: HEALTHY } } }
W20260811 15:00:57.743161 2961 tablet.cc:2369] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:00:57.752611 3195 tablet.cc:2369] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:00:57.792361 3247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.786767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.11.225.67:37875)
0811 15:00:57.786908 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:00:57.786913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:00:57.786930 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:00:57.787043 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:00:57.787047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:00:57.787133 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:00:57.787262 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:00:57.787739 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.788535 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.789847 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:00:57.790178 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:00:57.790287 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:00:57.790771 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:00:57.791457 (+ 686us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:00:57.791602 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:00:57.792118 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 15:00:57.792184 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:00:57.800786 2881 raft_consensus.cc:1261] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 1 FOLLOWER]: Refusing update from remote peer 110115b8294640c9b74d02fa024f8aaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:00:57.802126 3268 consensus_queue.cc:1035] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "267fb0d823d44d4e8839a9fcffeb126c" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:00:57.810256 2647 raft_consensus.cc:1261] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 1 FOLLOWER]: Refusing update from remote peer 110115b8294640c9b74d02fa024f8aaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:00:57.811125 3268 consensus_queue.cc:1035] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a39b7f2e514592bc47dae3a6f341e7" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:00:57.824899 3273 mvcc.cc:205] Tried to move back new op lower bound from 7317342035141505024 to 7317342034838765568. Current Snapshot: MvccSnapshot[applied={T|T < 7317342035141505024}]
I20260811 15:00:57.831020 3277 mvcc.cc:205] Tried to move back new op lower bound from 7317342035141505024 to 7317342034838765568. Current Snapshot: MvccSnapshot[applied={T|T < 7317342035141505024}]
I20260811 15:00:57.835590 3274 mvcc.cc:205] Tried to move back new op lower bound from 7317342035141505024 to 7317342034838765568. Current Snapshot: MvccSnapshot[applied={T|T < 7317342035141505024}]
I20260811 15:00:57.838135 2378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:00:57.838335 2378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:00:57.841274 2378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee30ef4972504bdd8bc76e886b466aaa: Sending DeleteTablet for 3 replicas of tablet e22adae87b20476e93ca097092d42f85
I20260811 15:00:57.842123 2613 tablet_service.cc:1514] Processing DeleteTablet for tablet e22adae87b20476e93ca097092d42f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:57 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:42054
I20260811 15:00:57.842423 3053 tablet_service.cc:1514] Processing DeleteTablet for tablet e22adae87b20476e93ca097092d42f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:57 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:41118
I20260811 15:00:57.842793 3284 tablet_replica.cc:330] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7: stopping tablet replica
I20260811 15:00:57.843183 3284 raft_consensus.cc:2229] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:00:57.843581 3284 raft_consensus.cc:2258] T e22adae87b20476e93ca097092d42f85 P b4a39b7f2e514592bc47dae3a6f341e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:00:57.843902 2844 tablet_service.cc:1514] Processing DeleteTablet for tablet e22adae87b20476e93ca097092d42f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:00:57 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:35986
I20260811 15:00:57.844434 3288 tablet_replica.cc:330] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: stopping tablet replica
I20260811 15:00:57.844553 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 2437
I20260811 15:00:57.858973 3288 raft_consensus.cc:2229] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:00:57.859524 3288 raft_consensus.cc:2258] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:00:57.861440 3285 tablet_replica.cc:330] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: stopping tablet replica
I20260811 15:00:57.861486 3288 ts_tablet_manager.cc:1905] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:00:57.861860 3285 raft_consensus.cc:2229] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:00:57.862304 3285 raft_consensus.cc:2258] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:00:57.864063 3285 ts_tablet_manager.cc:1905] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:00:57.864477 3288 ts_tablet_manager.cc:1918] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:00:57.864647 3288 log.cc:1196] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/e22adae87b20476e93ca097092d42f85
I20260811 15:00:57.865099 3288 ts_tablet_manager.cc:1939] T e22adae87b20476e93ca097092d42f85 P 267fb0d823d44d4e8839a9fcffeb126c: Deleting consensus metadata
W20260811 15:00:57.865980 2355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:41303 (error 108)
I20260811 15:00:57.866268 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 2735
I20260811 15:00:57.867199 3285 ts_tablet_manager.cc:1918] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:00:57.867331 3285 log.cc:1196] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/e22adae87b20476e93ca097092d42f85
I20260811 15:00:57.867632 3285 ts_tablet_manager.cc:1939] T e22adae87b20476e93ca097092d42f85 P 110115b8294640c9b74d02fa024f8aaf: Deleting consensus metadata
I20260811 15:00:57.870990 2356 catalog_manager.cc:4841] TS 110115b8294640c9b74d02fa024f8aaf (127.11.225.67:37875): tablet e22adae87b20476e93ca097092d42f85 (table test-table [id=e776d228e6bf4ab19478118cd0f74de5]) successfully deleted
I20260811 15:00:57.881845 3245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:00:57.881463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41303 (local address 127.0.0.1:42060)
0811 15:00:57.881659 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.881740 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:41303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260811 15:00:57.882218 2355 catalog_manager.cc:4584] TS b4a39b7f2e514592bc47dae3a6f341e7 (127.11.225.65:41303): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e22adae87b20476e93ca097092d42f85: Network error: Client connection negotiation failed: client connection to 127.11.225.65:41303: connect: Connection refused (error 111)
W20260811 15:00:57.882571 3244 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:00:57.881783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35103 (local address 127.0.0.1:36002)
0811 15:00:57.881966 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 15:00:57.881982 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:00:57.882108 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:00:57.882462 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.66:35103: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 15:00:57.883253 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 2965
I20260811 15:00:57.906733 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 2323
I20260811 15:00:57.929018 12165 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 15:00:58.274400 12165 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 15:00:58.274552 12165 mini_ranger.cc:66] Stopping Ranger...
I20260811 15:00:58.629906 12165 mini_ranger.cc:68] Stopped Ranger
2026-08-11 15:00:58.630 UTC [692] LOG: received smart shutdown request
2026-08-11 15:00:58.635 UTC [692] LOG: background worker "logical replication launcher" (PID 710) exited with exit code 1
2026-08-11 15:00:58.635 UTC [697] LOG: shutting down
2026-08-11 15:00:58.811 UTC [692] LOG: database system is shut down
2026-08-11T15:00:58Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51968 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:00:59 dist-test-slave-8hhm krb5kdc[3301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:00:59 dist-test-slave-8hhm krb5kdc[3301](info): set up 2 sockets
Aug 11 15:00:59 dist-test-slave-8hhm krb5kdc[3301](info): commencing operation
krb5kdc: starting...
W20260811 15:01:00.236543 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:01:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:01:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:01:00.370512 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43863
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:00.485960 3327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:00.486274 3327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:00.486354 3327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:00.490382 3327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:00.490607 3327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:00.490707 3327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:00.490751 3327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:00.490788 3327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:00.496289 3327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:00.497469 3327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:00.498549 3327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:00.507296 3341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:00.507295 3344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:00.507376 3327 server_base.cc:1034] running on GCE node
W20260811 15:01:00.507652 3340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:00.508224 3327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:00.509385 3327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:00.510560 3327 hybrid_clock.cc:648] HybridClock initialized: now 1786460460510539 us; error 30 us; skew 500 ppm
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:00.513449 3327 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:00.514297 3327 webserver.cc:460] Webserver started at http://127.11.225.126:35427/ using document root <none> and password file <none>
I20260811 15:01:00.514829 3327 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:00.514900 3327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:00.515062 3327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:00.517136 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "73f57fc5eede4ec8a066a70b449e39da"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "698b2cde671f76e92da1b25de1285943"
server_key_iv: "7a2e87d3993c007abe943a53c229f9de"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.517764 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "73f57fc5eede4ec8a066a70b449e39da"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "698b2cde671f76e92da1b25de1285943"
server_key_iv: "7a2e87d3993c007abe943a53c229f9de"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.521414 3327 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:00.523818 3356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:00.525061 3327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:00.525162 3327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "73f57fc5eede4ec8a066a70b449e39da"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "698b2cde671f76e92da1b25de1285943"
server_key_iv: "7a2e87d3993c007abe943a53c229f9de"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.525321 3327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:00.536178 3327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:00.539511 3327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:00.539673 3327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:00.546775 3327 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:43863
I20260811 15:01:00.547087 3444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:43863 every 8 connection(s)
I20260811 15:01:00.547868 3327 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:00.550822 3445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:00.554684 3445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:00.558077 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 3327
I20260811 15:01:00.558229 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:01:00.558506 12165 external_mini_cluster.cc:1428] Setting key 43a106f44d355cc3078b9877cb027369
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.125@KRBTEST.COM; defaulting to no policy
I20260811 15:01:00.571172 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.556959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.11.225.126:43863)
0811 15:01:00.557421 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:00.557439 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:00.557613 (+ 174us) server_negotiation.cc:407] Connection header received
0811 15:01:00.558710 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:00.558717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:00.558963 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:00.559180 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:00.559964 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.561186 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.562742 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.563101 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.563225 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.566292 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:00.566298 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:00.566308 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:00.566328 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:00.567984 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.568585 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.568590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.568591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.568759 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.569128 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.569130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.569131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.569549 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:00.569669 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:00.570132 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 15:01:00.570336 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":341,"spinlock_wait_cycles":37632,"thread_start_us":198,"threads_started":1}
I20260811 15:01:00.571169 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.556959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43863 (local address 127.0.0.1:54454)
0811 15:01:00.557463 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.557501 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:00.558387 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:00.559184 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:00.559189 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:00.559531 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:00.559806 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.559819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.561364 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.561370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.562592 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.562607 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.563274 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.563281 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.563440 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.564053 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:00.564076 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:00.566143 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:00.568107 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.568120 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.568134 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.568460 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.568858 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.568862 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.568866 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.569041 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.569742 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:00.569748 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:00.569876 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 15:01:00.570051 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 15:01:00.570474 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":125,"thread_start_us":123,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.125@KRBTEST.COM" created.
I20260811 15:01:00.574030 3445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:00.574883 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.574561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59722)
0811 15:01:00.574711 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.574802 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 15:01:00.575110 3362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
I20260811 15:01:00.576046 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.575836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59738)
0811 15:01:00.575944 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.575989 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 15:01:00.576272 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:35929: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
I20260811 15:01:00.588591 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:35929
--webserver_interface=127.11.225.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:00.625576 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } attempt: 1
I20260811 15:01:00.626561 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.626220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59740)
0811 15:01:00.626412 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.626478 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 15:01:00.627321 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.627089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59752)
0811 15:01:00.627199 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.627252 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:01:00.627456 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:35929: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
I20260811 15:01:00.695636 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } attempt: 2
I20260811 15:01:00.696578 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.696256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59764)
0811 15:01:00.696421 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.696486 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 15:01:00.697373 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.697124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59770)
0811 15:01:00.697268 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.697320 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 15:01:00.697497 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:35929: Network error: Client connection negotiation failed: client connection to 127.11.225.125:35929: connect: Connection refused (error 111)
W20260811 15:01:00.706317 3459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:00.706599 3459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:00.706698 3459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:00.710757 3459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:00.710832 3459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:00.710868 3459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:00.710922 3459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:00.710958 3459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:00.716326 3459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:35929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.225.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:00.717525 3459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:00.718601 3459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:00.727537 3473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:00.727576 3469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:00.727576 3471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:00.727850 3459 server_base.cc:1034] running on GCE node
I20260811 15:01:00.728508 3459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:00.729799 3459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:00.730967 3459 hybrid_clock.cc:648] HybridClock initialized: now 1786460460730947 us; error 31 us; skew 500 ppm
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:00.734102 3459 init.cc:377] Logged in from keytab as kudu/127.11.225.125@KRBTEST.COM (short username kudu)
I20260811 15:01:00.735067 3459 webserver.cc:460] Webserver started at http://127.11.225.125:33039/ using document root <none> and password file <none>
I20260811 15:01:00.735653 3459 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:00.735762 3459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:00.736009 3459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:00.738209 3459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data/instance:
uuid: "48cf02a7e44540adb706096ff7d654a9"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "a9cb07e7e203b5a19e3e5b34bb7ddbe2"
server_key_iv: "1bcd4649183b6b4a539441230705f0fd"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.738812 3459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal/instance:
uuid: "48cf02a7e44540adb706096ff7d654a9"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "a9cb07e7e203b5a19e3e5b34bb7ddbe2"
server_key_iv: "1bcd4649183b6b4a539441230705f0fd"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.742806 3459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:01:00.745431 3482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:00.746773 3459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:00.746942 3459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "48cf02a7e44540adb706096ff7d654a9"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "a9cb07e7e203b5a19e3e5b34bb7ddbe2"
server_key_iv: "1bcd4649183b6b4a539441230705f0fd"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.747076 3459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:00.772128 3459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:00.776474 3459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:00.776706 3459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:00.783982 3459 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.125:35929
I20260811 15:01:00.784291 3574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.125:35929 every 8 connection(s)
I20260811 15:01:00.785008 3459 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
I20260811 15:01:00.785849 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 3459
I20260811 15:01:00.785997 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-1/wal/instance
I20260811 15:01:00.786324 12165 external_mini_cluster.cc:1428] Setting key 83e12dcdc8299f8bb414711e9157f1c8
I20260811 15:01:00.788677 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } attempt: 3
I20260811 15:01:00.788862 3575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:00.794620 3575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.225.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.124@KRBTEST.COM" created.
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:00.805964 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.789277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59776)
0811 15:01:00.789486 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.789503 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:00.789615 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:00.792525 (+ 2910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:00.792530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:00.792766 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:00.792956 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.792970 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.794868 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.794874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.795831 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.795847 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.796750 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.796753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.796877 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.797463 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:00.797475 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:00.800398 (+ 2923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:00.803285 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.803290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.803294 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.803579 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.803992 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.803998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.804002 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.804110 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.805174 (+ 1064us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:00.805180 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:00.805333 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 15:01:00.805475 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 15:01:00.805744 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 15:01:00.807121 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.790128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59776 (local address 127.11.225.125:35929)
0811 15:01:00.790661 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:00.790682 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:00.790728 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:01:00.791578 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:00.791604 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:00.792108 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:00.792575 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:00.793141 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.794707 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.795998 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.796600 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.797337 (+ 737us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.800619 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:00.800629 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:00.800644 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:00.800684 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:00.803157 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.803728 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.803734 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.803740 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.803872 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.804223 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.804227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.804230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.804806 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:00.804964 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:00.805658 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 15:01:00.806030 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":126,"threads_started":1}
I20260811 15:01:00.807739 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.796629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43863 (local address 127.0.0.1:54464)
0811 15:01:00.797384 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.797447 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:00.797557 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:00.797888 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:00.797893 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:00.798261 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:00.798395 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.798400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.799212 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.799215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.800173 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.800184 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.801248 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.801255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.801420 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.802059 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:00.802079 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:00.803968 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:00.805954 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.805962 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.805969 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.806229 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.806561 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.806564 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.806566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.806649 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.807155 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:00.807161 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:00.807282 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 15:01:00.807466 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 15:01:00.807621 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":140,"threads_started":1}
I20260811 15:01:00.807839 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.796710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54464 (local address 127.11.225.126:43863)
0811 15:01:00.796843 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:00.796847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:00.797541 (+ 694us) server_negotiation.cc:407] Connection header received
0811 15:01:00.797642 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:00.797646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:00.797698 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:00.797826 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:00.798526 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.799093 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.800303 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.801087 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.801235 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.804098 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:00.804101 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:00.804103 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:00.804126 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:00.805829 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.806346 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.806350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.806351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.806433 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.806758 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.806765 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.806770 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.807021 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:00.807140 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:00.807576 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 15:01:00.807701 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:01:00.808966 3575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:00.809697 3445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:00.810473 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.810159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49740)
0811 15:01:00.810307 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.810373 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:01:00.811245 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.810935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49748)
0811 15:01:00.811110 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.811169 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260811 15:01:00.811462 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:01:00.818006 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.809528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59782)
0811 15:01:00.809647 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.809662 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:00.809737 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:00.809970 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:00.809972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:00.810146 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:00.810241 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.810248 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.811161 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.811167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.811681 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:00.811688 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.812159 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.812162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:00.812240 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.812659 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:00.812706 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:00.814720 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:00.816476 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.816484 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.816487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.816725 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.816981 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:00.816983 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:00.816984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:00.817058 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:00.817503 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:00.817505 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:00.817585 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 15:01:00.817757 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 15:01:00.817871 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 15:01:00.818073 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.809619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59782 (local address 127.11.225.125:35929)
0811 15:01:00.809745 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:00.809749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:00.809763 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:01:00.809802 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:00.809804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:00.809846 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:00.809939 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:00.810356 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.811074 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.811811 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:00.812050 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:00.812158 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:00.814851 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:00.814854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:00.814855 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:00.814876 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:00.816349 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.816820 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.816823 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.816824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.816897 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:00.817183 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:00.817185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:00.817186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:00.817416 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:00.817494 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:00.817802 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 15:01:00.817927 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":63}
I20260811 15:01:00.818758 3575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:00.819458 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.819190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49762)
0811 15:01:00.819305 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.819391 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
W20260811 15:01:00.820287 3487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:00.821084 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:33851
--webserver_interface=127.11.225.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:00.821273 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.821003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49772)
0811 15:01:00.821117 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.821162 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 15:01:00.821396 3575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:00.842617 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 1
I20260811 15:01:00.843546 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.843205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49776)
0811 15:01:00.843386 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.843451 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 15:01:00.844331 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.844111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49780)
0811 15:01:00.844225 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.844277 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 15:01:00.844453 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:00.870678 3575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 1
I20260811 15:01:00.871636 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.871294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49786)
0811 15:01:00.871464 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.871538 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 15:01:00.872453 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.872222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49798)
0811 15:01:00.872332 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.872386 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 15:01:00.872658 3575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:00.919662 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 2
I20260811 15:01:00.920653 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.920311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49810)
0811 15:01:00.920497 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.920564 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 15:01:00.921566 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.921331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49820)
0811 15:01:00.921443 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.921505 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:01:00.921691 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:00.940876 3575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 2
I20260811 15:01:00.941891 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.941481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49834)
0811 15:01:00.941681 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.941773 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 15:01:00.942770 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:00.942498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49838)
0811 15:01:00.942628 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:00.942693 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 15:01:00.942943 3575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
W20260811 15:01:00.946710 3588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:00.947118 3588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:00.947248 3588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:00.952103 3588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:00.952173 3588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:00.952221 3588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:00.952263 3588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:00.952309 3588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:00.958523 3588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43863,127.11.225.125:35929,127.11.225.124:33851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:33851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.225.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:00.959764 3588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:00.960989 3588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:00.970494 3600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:00.970568 3598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:00.970569 3607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:00.970685 3588 server_base.cc:1034] running on GCE node
I20260811 15:01:00.971632 3588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:00.972967 3588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:00.974206 3588 hybrid_clock.cc:648] HybridClock initialized: now 1786460460974179 us; error 69 us; skew 500 ppm
Aug 11 15:01:00 dist-test-slave-8hhm krb5kdc[3301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:00.977523 3588 init.cc:377] Logged in from keytab as kudu/127.11.225.124@KRBTEST.COM (short username kudu)
I20260811 15:01:00.978664 3588 webserver.cc:460] Webserver started at http://127.11.225.124:40873/ using document root <none> and password file <none>
I20260811 15:01:00.979322 3588 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:00.979432 3588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:00.979727 3588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:00.982474 3588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data/instance:
uuid: "f14a2975004a47219bbac3c1d8fabdaf"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "2cfab15f3ee7eca6cb4f75855f9413ab"
server_key_iv: "dc75049141cd3e47f5e8081ee766d724"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.983163 3588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal/instance:
uuid: "f14a2975004a47219bbac3c1d8fabdaf"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "2cfab15f3ee7eca6cb4f75855f9413ab"
server_key_iv: "dc75049141cd3e47f5e8081ee766d724"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.987512 3588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:01:00.990339 3617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:00.991729 3588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:00.991881 3588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "f14a2975004a47219bbac3c1d8fabdaf"
format_stamp: "Formatted at 2026-08-11 15:01:00 on dist-test-slave-8hhm"
server_key: "2cfab15f3ee7eca6cb4f75855f9413ab"
server_key_iv: "dc75049141cd3e47f5e8081ee766d724"
server_key_version: "encryptionkey@0"
I20260811 15:01:00.992003 3588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:01.018206 3588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:01.020869 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 3
I20260811 15:01:01.021747 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.021450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49852)
0811 15:01:01.021606 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.021665 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 15:01:01.021809 3588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:01.022022 3588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:01.022504 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.022310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49868)
0811 15:01:01.022411 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.022454 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:01:01.022625 3445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:33851: Network error: Client connection negotiation failed: client connection to 127.11.225.124:33851: connect: Connection refused (error 111)
I20260811 15:01:01.029683 3588 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.124:33851
I20260811 15:01:01.030004 3696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.124:33851 every 8 connection(s)
I20260811 15:01:01.030718 3588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
I20260811 15:01:01.033705 3697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:01.034138 3575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 3
I20260811 15:01:01.038687 3697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:01.039178 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 3588
I20260811 15:01:01.039331 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460289406450-12165-0/minicluster-data/master-2/wal/instance
I20260811 15:01:01.039602 12165 external_mini_cluster.cc:1428] Setting key 06d09b7514cdc68ce1655faf75be3981
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:01.047713 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.034711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49884)
0811 15:01:01.034869 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.034886 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:01.034987 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:01.037323 (+ 2336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:01.037327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:01.037533 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:01.037645 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.037652 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.039003 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.039010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.039787 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.039799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.040816 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.040819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.040904 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.041506 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:01.041525 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:01.043124 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:01.045614 (+ 2490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.045618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.045620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.045825 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.046261 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.046266 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.046268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.046376 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.047208 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:01.047212 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:01.047329 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 15:01:01.047454 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 15:01:01.047583 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:01:01.049374 3702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.035506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.11.225.124:33851)
0811 15:01:01.035958 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.035974 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.036012 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:01:01.036657 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.036674 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.036998 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.037369 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.037837 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.038804 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.039943 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.040650 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.040855 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.043315 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.043321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.043332 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.043366 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.045496 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.045950 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.045956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.045965 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.046120 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.046510 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.046515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.046519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.047085 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.047242 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.048157 (+ 915us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.048373 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":150,"threads_started":1}
I20260811 15:01:01.052083 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.041741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54472 (local address 127.11.225.126:43863)
0811 15:01:01.041863 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.041869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.042231 (+ 362us) server_negotiation.cc:407] Connection header received
0811 15:01:01.042385 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.042392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.042436 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.042536 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.043335 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.044058 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.045269 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.045605 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.045714 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.047998 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.048002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.048005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.048034 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.049895 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.050531 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.050536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.050540 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.050638 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.050990 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.050993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.050995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.051204 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.051379 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.051747 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.051883 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:01:01.052376 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.040978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:43863 (local address 127.0.0.1:54472)
0811 15:01:01.041417 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.042134 (+ 717us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:01.042274 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:01.042585 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:01.042591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:01.043057 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:01.043201 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.043209 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.044199 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.044203 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.045123 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.045131 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.045715 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.045718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.045839 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.046371 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:01.046383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:01.047817 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:01.050017 (+ 2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.050026 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.050032 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.050428 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.050800 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.050802 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.050804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.050885 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.051321 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:01.051327 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:01.051457 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 15:01:01.051655 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 15:01:01.051919 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":91,"threads_started":1}
I20260811 15:01:01.053534 3697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:01:01.054258 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.040353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49886 (local address 127.11.225.124:33851)
0811 15:01:01.040713 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.040723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.041467 (+ 744us) server_negotiation.cc:407] Connection header received
0811 15:01:01.041581 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.041586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.041636 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.041724 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.042676 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.043424 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.044554 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.044903 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.044997 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.048847 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.048851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.048854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.048876 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.052174 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.052712 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.052715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.052717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.052807 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.053134 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.053137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.053138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.053398 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.053574 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.053936 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.054071 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":187,"threads_started":1}
I20260811 15:01:01.054431 3575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: Bootstrap starting.
I20260811 15:01:01.057523 3575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:01.058485 3575 log.cc:824] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:01.061007 3575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: No bootstrap required, opened a new log
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:01:01.065310 3575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.065654 3575 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:01.065734 3575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf02a7e44540adb706096ff7d654a9, State: Initialized, Role: FOLLOWER
I20260811 15:01:01.066087 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.055677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.11.225.126:43863)
0811 15:01:01.055784 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.055789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.055906 (+ 117us) server_negotiation.cc:407] Connection header received
0811 15:01:01.056081 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.056083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.056119 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.056181 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.056904 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.057487 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.058570 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.058840 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.058927 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.061892 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.061896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.061899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.061925 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.063638 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.064172 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.064178 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.064180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.064281 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.064630 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.064633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.064635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.064838 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.065093 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.065656 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.065795 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 15:01:01.066361 3575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.067667 3709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.067852 3709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.068073 3575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:01.068648 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.059085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59796 (local address 127.11.225.125:35929)
0811 15:01:01.059224 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.059228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.059261 (+ 33us) server_negotiation.cc:407] Connection header received
0811 15:01:01.059304 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.059309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.059353 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.059437 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.059904 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.060602 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.061784 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.062095 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.062201 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.064676 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.064680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.064683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.064711 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.066662 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.067151 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.067155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.067156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.067249 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.067577 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.067580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.067582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.067789 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.067862 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.068372 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.068505 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:01:01.069340 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.054045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:35929 (local address 127.0.0.1:59796)
0811 15:01:01.054290 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.054306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:01.054393 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:01.059486 (+ 5093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:01.059492 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:01.059682 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:01.059779 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.059786 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.060741 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.060745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.061644 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.061657 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.062325 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.062328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.062423 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.062890 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:01.062906 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:01.064521 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:01.066768 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.066771 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.066773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.067043 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.067366 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.067369 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.067371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.067468 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.068053 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:01.068056 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:01.068167 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 15:01:01.068770 (+ 603us) client_negotiation.cc:240] Negotiation successful
0811 15:01:01.068962 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260811 15:01:01.070278 3697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
W20260811 15:01:01.074836 3732 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:01:01.074973 3732 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:01:01.072676 3459 master_runner.cc:186] Error getting master registration for 127.11.225.126:43863: OK, instance_id { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" instance_seqno: 1786460460544691 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:01:01.076900 3459 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:01:01.079101 3712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.067389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.11.225.125:35929)
0811 15:01:01.067997 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.068019 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.068031 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:01:01.068059 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.068061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.068095 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.068247 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.068957 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.069828 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.070970 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.071349 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.071427 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.074804 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.074808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.074811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.074838 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.077289 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.077733 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.077736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.077738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.077832 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.078126 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.078130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.078131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.078325 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.078530 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.078749 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.078877 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":107,"threads_started":1}
I20260811 15:01:01.079550 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.070851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49898)
0811 15:01:01.070972 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.070987 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:01.071056 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:01.071414 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:01.071417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:01.071603 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:01.071730 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.071738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.072625 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.072628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.073460 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.073471 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.074219 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.074222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.074299 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.074740 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:01.074754 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:01.076162 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:01.078098 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.078100 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.078102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.078332 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.078604 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.078606 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.078609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.078681 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.079083 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:01.079085 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:01.079168 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 15:01:01.079263 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 15:01:01.079391 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 15:01:01.080106 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.071022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49898 (local address 127.11.225.124:33851)
0811 15:01:01.071119 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.071126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.071141 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:01:01.071181 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.071185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.071234 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.071316 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.071843 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.072522 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.073610 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.074011 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.074116 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.076291 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.076294 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.076297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.076317 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.077985 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.078429 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.078431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.078433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.078516 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.078757 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.078760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.078762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.078956 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.079049 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.079859 (+ 810us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.079971 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 15:01:01.082589 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:01:01.083357 3697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: Bootstrap starting.
I20260811 15:01:01.086334 3697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:01.087352 3697 log.cc:824] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:01.095371 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.084782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.11.225.126:43863)
0811 15:01:01.085010 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.085029 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.086192 (+ 1163us) server_negotiation.cc:407] Connection header received
0811 15:01:01.086391 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.086397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.086451 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.086511 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.087431 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.088149 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.089269 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.089618 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.089726 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.091583 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.091587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.091592 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.091623 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.093320 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.093806 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.093809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.093811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.093900 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.094195 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.094198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.094200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.094404 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.094537 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.095082 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.095204 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260811 15:01:01.097299 3712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.084745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.11.225.125:35929)
0811 15:01:01.084901 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.084906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.085482 (+ 576us) server_negotiation.cc:407] Connection header received
0811 15:01:01.085697 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.085700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.085756 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.085815 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.086978 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.087846 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.089070 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.089450 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.089551 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.091670 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.091674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.091676 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.091724 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.094314 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.094939 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.094945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.094950 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.095050 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.095953 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.095962 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.095964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.096461 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.096607 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.096949 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.097086 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 15:01:01.098712 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.085558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49900 (local address 127.11.225.124:33851)
0811 15:01:01.085953 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.085957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.089441 (+ 3484us) server_negotiation.cc:407] Connection header received
0811 15:01:01.089616 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.089619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.089669 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.089723 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.090716 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.091526 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.092718 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.093131 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.093258 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.095151 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.095157 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.095161 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.095187 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.096867 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.097377 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.097382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.097383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.097471 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.097818 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.097822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.097824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.098034 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.098154 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.098438 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.098564 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316}
I20260811 15:01:01.103302 3697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: No bootstrap required, opened a new log
I20260811 15:01:01.107290 3697 raft_consensus.cc:348] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.107560 3697 raft_consensus.cc:374] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:01.107646 3697 raft_consensus.cc:729] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14a2975004a47219bbac3c1d8fabdaf, State: Initialized, Role: FOLLOWER
I20260811 15:01:01.108184 3697 consensus_queue.cc:260] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.108703 3752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.108846 3752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.109741 3697 sys_catalog.cc:564] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:01:01.115175 3774 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:01:01.115264 3774 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:01:01.113873 3588 master_runner.cc:186] Error getting master registration for 127.11.225.126:43863: OK, instance_id { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" instance_seqno: 1786460460544691 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:01:01.117177 3588 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:01:01.186797 3445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } attempt: 4
Aug 11 15:01:01 dist-test-slave-8hhm krb5kdc[3301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:01:01.197427 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.187315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:33851 (local address 127.0.0.1:49906)
0811 15:01:01.187529 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:01.187547 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:01.187635 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:01.187948 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:01.187953 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:01.188213 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:01.188333 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.188340 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.189464 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.189468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.190342 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:01.190353 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.190933 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.190937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:01.191029 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.191712 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:01.191729 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:01.193423 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:01.195683 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.195686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.195689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.195954 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.196269 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:01.196272 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:01.196274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:01.196359 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:01.196843 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:01.196846 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:01.196947 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 15:01:01.197049 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 15:01:01.197200 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260811 15:01:01.198345 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:01.187411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.11.225.124:33851)
0811 15:01:01.187560 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:01.187564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:01.187585 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:01:01.187738 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:01.187743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:01.187798 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:01.187890 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:01.188489 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.189333 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.190475 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:01.190801 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:01.190907 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:01.193580 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:01.193584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:01.193587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:01.193615 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:01.195551 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.196074 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.196078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.196080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.196167 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:01.196456 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:01.196459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:01.196461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:01.196707 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:01.196797 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:01.198070 (+ 1273us) server_negotiation.cc:299] Negotiation successful
0811 15:01:01.198192 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 15:01:01.201647 3445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: Bootstrap starting.
I20260811 15:01:01.204566 3445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:01.205483 3445 log.cc:824] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:01.207864 3445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: No bootstrap required, opened a new log
I20260811 15:01:01.212123 3445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.212392 3445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:01.212462 3445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f57fc5eede4ec8a066a70b449e39da, State: Initialized, Role: FOLLOWER
I20260811 15:01:01.213008 3445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.213613 3777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.213819 3777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.216651 3445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:01:01.222049 3796 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:01:01.222194 3796 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:01:01.227219 3327 master_runner.cc:263] No leader master found from master 73f57fc5eede4ec8a066a70b449e39da
I20260811 15:01:01.227305 3327 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 15:01:01.273746 3624 tablet.cc:2369] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:01:01.278486 3494 tablet.cc:2369] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:01:01.291357 3364 tablet.cc:2369] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:01.363382 3709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:01.363618 3709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.364761 3709 leader_election.cc:288] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73f57fc5eede4ec8a066a70b449e39da (127.11.225.126:43863), f14a2975004a47219bbac3c1d8fabdaf (127.11.225.124:33851)
I20260811 15:01:01.365499 3396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48cf02a7e44540adb706096ff7d654a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73f57fc5eede4ec8a066a70b449e39da" is_pre_election: true
I20260811 15:01:01.365521 3657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48cf02a7e44540adb706096ff7d654a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14a2975004a47219bbac3c1d8fabdaf" is_pre_election: true
I20260811 15:01:01.365862 3396 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf02a7e44540adb706096ff7d654a9 in term 0.
I20260811 15:01:01.365862 3657 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf02a7e44540adb706096ff7d654a9 in term 0.
I20260811 15:01:01.366350 3487 leader_election.cc:302] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf02a7e44540adb706096ff7d654a9, f14a2975004a47219bbac3c1d8fabdaf; no voters:
I20260811 15:01:01.366685 3709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:01:01.366793 3709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:01:01.366835 3709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:01.368250 3709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.368600 3709 leader_election.cc:288] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [CANDIDATE]: Term 1 election: Requested vote from peers 73f57fc5eede4ec8a066a70b449e39da (127.11.225.126:43863), f14a2975004a47219bbac3c1d8fabdaf (127.11.225.124:33851)
I20260811 15:01:01.368908 3396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48cf02a7e44540adb706096ff7d654a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73f57fc5eede4ec8a066a70b449e39da"
I20260811 15:01:01.369052 3396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:01.369045 3657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48cf02a7e44540adb706096ff7d654a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14a2975004a47219bbac3c1d8fabdaf"
I20260811 15:01:01.369184 3657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:01.370265 3396 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf02a7e44540adb706096ff7d654a9 in term 1.
I20260811 15:01:01.370450 3657 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf02a7e44540adb706096ff7d654a9 in term 1.
I20260811 15:01:01.370597 3487 leader_election.cc:302] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf02a7e44540adb706096ff7d654a9, 73f57fc5eede4ec8a066a70b449e39da; no voters:
I20260811 15:01:01.370961 3709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:01.371212 3709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [term 1 LEADER]: Becoming Leader. State: Replica: 48cf02a7e44540adb706096ff7d654a9, State: Running, Role: LEADER
I20260811 15:01:01.371582 3709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } }
I20260811 15:01:01.373783 3799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48cf02a7e44540adb706096ff7d654a9. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.373917 3799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:01.374310 3802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:01.375428 3802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:01.380187 3657 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [term 1 FOLLOWER]: Refusing update from remote peer 48cf02a7e44540adb706096ff7d654a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:01.380220 3396 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [term 1 FOLLOWER]: Refusing update from remote peer 48cf02a7e44540adb706096ff7d654a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:01.380861 3799 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:01.381129 3709 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:01.385308 3752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48cf02a7e44540adb706096ff7d654a9. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.385310 3777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48cf02a7e44540adb706096ff7d654a9. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.385432 3752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.385448 3777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.387959 3709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.388095 3709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:01.388329 3807 mvcc.cc:205] Tried to move back new op lower bound from 7317342049806254080 to 7317342049781088256. Current Snapshot: MvccSnapshot[applied={T|T < 7317342049806254080}]
I20260811 15:01:01.388438 3777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.388435 3752 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.388553 3752 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.388553 3777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:01:01.388671 3709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "48cf02a7e44540adb706096ff7d654a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73f57fc5eede4ec8a066a70b449e39da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43863 } } peers { permanent_uuid: "48cf02a7e44540adb706096ff7d654a9" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 35929 } } peers { permanent_uuid: "f14a2975004a47219bbac3c1d8fabdaf" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 33851 } } }
I20260811 15:01:01.388796 3709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:01.389062 3805 mvcc.cc:205] Tried to move back new op lower bound from 7317342049806254080 to 7317342049781088256. Current Snapshot: MvccSnapshot[applied={T|T < 7317342049806254080}]
I20260811 15:01:01.390636 3802 catalog_manager.cc:1347] Generated new cluster ID: 02907a1f23114cc0b26da908e79923cb
I20260811 15:01:01.390712 3802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:01.408996 3802 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:01:01.410595 3802 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:01.416574 3802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48cf02a7e44540adb706096ff7d654a9: Generated new TSK 0
I20260811 15:01:01.417665 3802 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:01:02.116780 3774 catalog_manager.cc:1259] Loaded cluster ID: 02907a1f23114cc0b26da908e79923cb
I20260811 15:01:02.116871 3774 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: loading cluster ID for follower catalog manager: success
I20260811 15:01:02.118837 3774 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: acquiring CA information for follower catalog manager: success
I20260811 15:01:02.120018 3774 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f14a2975004a47219bbac3c1d8fabdaf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:01:02.223680 3796 catalog_manager.cc:1259] Loaded cluster ID: 02907a1f23114cc0b26da908e79923cb
I20260811 15:01:02.223778 3796 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: loading cluster ID for follower catalog manager: success
I20260811 15:01:02.225618 3796 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: acquiring CA information for follower catalog manager: success
I20260811 15:01:02.226850 3796 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 73f57fc5eede4ec8a066a70b449e39da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:01:02.474792 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 3327
I20260811 15:01:02.495118 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 3459
I20260811 15:01:02.508932 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 3588
2026-08-11T15:01:02Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3559 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:01:02 dist-test-slave-8hhm krb5kdc[3826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:01:02 dist-test-slave-8hhm krb5kdc[3826](info): set up 2 sockets
Aug 11 15:01:02 dist-test-slave-8hhm krb5kdc[3826](info): commencing operation
krb5kdc: starting...
W20260811 15:01:03.809626 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:01:03 dist-test-slave-8hhm krb5kdc[3826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:01:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:01:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:01:03.944713 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46039
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:34601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:46039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:04.062445 3848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:04.062748 3848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:04.062826 3848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:04.066877 3848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:04.066958 3848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:04.067003 3848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:04.067061 3848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:04.067101 3848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:04.072333 3848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:34601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:46039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:04.073563 3848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:04.074635 3848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:04.083520 3862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:04.083746 3848 server_base.cc:1034] running on GCE node
W20260811 15:01:04.083520 3868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:04.083523 3866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:04.084604 3848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:04.085882 3848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:04.087121 3848 hybrid_clock.cc:648] HybridClock initialized: now 1786460464087107 us; error 27 us; skew 500 ppm
Aug 11 15:01:04 dist-test-slave-8hhm krb5kdc[3826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460464, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:04.090234 3848 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:04.091221 3848 webserver.cc:460] Webserver started at http://127.11.225.126:44961/ using document root <none> and password file <none>
I20260811 15:01:04.091846 3848 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:04.091943 3848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:04.092191 3848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:04.094391 3848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "3fb86f5ec3034913aba5ae1380932a09"
format_stamp: "Formatted at 2026-08-11 15:01:04 on dist-test-slave-8hhm"
server_key: "4e87b4a4b0447829189410b37aa56573"
server_key_iv: "498ae1e32c6f6ad3b7222faaca7e7a61"
server_key_version: "encryptionkey@0"
I20260811 15:01:04.095002 3848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "3fb86f5ec3034913aba5ae1380932a09"
format_stamp: "Formatted at 2026-08-11 15:01:04 on dist-test-slave-8hhm"
server_key: "4e87b4a4b0447829189410b37aa56573"
server_key_iv: "498ae1e32c6f6ad3b7222faaca7e7a61"
server_key_version: "encryptionkey@0"
I20260811 15:01:04.098907 3848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:01:04.101641 3877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:04.102953 3848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:04.103122 3848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "3fb86f5ec3034913aba5ae1380932a09"
format_stamp: "Formatted at 2026-08-11 15:01:04 on dist-test-slave-8hhm"
server_key: "4e87b4a4b0447829189410b37aa56573"
server_key_iv: "498ae1e32c6f6ad3b7222faaca7e7a61"
server_key_version: "encryptionkey@0"
I20260811 15:01:04.103250 3848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:04.118840 3848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:04.121867 3848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:04.122107 3848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:04.129544 3848 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:46039
I20260811 15:01:04.129585 3969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:46039 every 8 connection(s)
I20260811 15:01:04.130550 3848 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:04.132382 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 3848
I20260811 15:01:04.132474 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:01:04.132781 12165 external_mini_cluster.cc:1428] Setting key 64ad9e8e9a6e520332be3a99508f4f59
I20260811 15:01:04.133827 3971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:04.140933 3971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: Bootstrap starting.
Aug 11 15:01:04 dist-test-slave-8hhm krb5kdc[3826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:04.143761 3971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:04.144734 3971 log.cc:824] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:04.147291 3971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: No bootstrap required, opened a new log
I20260811 15:01:04.148687 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:04.134345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.11.225.126:46039)
0811 15:01:04.134783 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:04.134803 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:04.134847 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:01:04.135761 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:04.135783 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:04.136210 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:04.136600 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:04.137345 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:04.138771 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:04.139639 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:04.140312 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:04.140485 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:04.143309 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:04.143315 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:04.143332 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:04.143364 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:04.145449 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:04.145941 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:04.145948 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:04.145954 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:04.146092 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:04.146369 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:04.146372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:04.146373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:04.146924 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:04.147121 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:04.147424 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 15:01:04.147752 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":124,"threads_started":1}
I20260811 15:01:04.151903 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:01:04.151847 3971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } }
I20260811 15:01:04.152137 3971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:04.152215 3971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb86f5ec3034913aba5ae1380932a09, State: Initialized, Role: FOLLOWER
I20260811 15:01:04.152654 3971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } }
I20260811 15:01:04.152810 3971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:04.152902 3971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:04.153021 3971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:04.154141 3971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } }
I20260811 15:01:04.154486 3971 leader_election.cc:302] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fb86f5ec3034913aba5ae1380932a09; no voters:
I20260811 15:01:04.154803 3971 leader_election.cc:288] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:01:04.154982 3978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:04.155328 3978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [term 1 LEADER]: Becoming Leader. State: Replica: 3fb86f5ec3034913aba5ae1380932a09, State: Running, Role: LEADER
I20260811 15:01:04.155692 3978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } }
I20260811 15:01:04.156111 3971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:04.157392 3981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fb86f5ec3034913aba5ae1380932a09. Latest consensus state: current_term: 1 leader_uuid: "3fb86f5ec3034913aba5ae1380932a09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } } }
I20260811 15:01:04.157528 3981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:04.157896 3979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fb86f5ec3034913aba5ae1380932a09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb86f5ec3034913aba5ae1380932a09" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46039 } } }
I20260811 15:01:04.158141 3979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09 [sys.catalog]: This master's current role is: LEADER
W20260811 15:01:04.160967 3997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:01:04.161115 3997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:01:04.161203 3990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:04.161993 3990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:04.167024 3990 catalog_manager.cc:1347] Generated new cluster ID: 9b493052dd7648c49a527eeee1d49c6e
I20260811 15:01:04.167088 3990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:04.180496 3990 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:01:04.181566 3990 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:04.187662 3990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fb86f5ec3034913aba5ae1380932a09: Generated new TSK 0
I20260811 15:01:04.188598 3990 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:01:04.208756 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 3848
2026-08-11T15:01:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1706 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:01:04 dist-test-slave-8hhm krb5kdc[4013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:01:04 dist-test-slave-8hhm krb5kdc[4013](info): set up 2 sockets
Aug 11 15:01:04 dist-test-slave-8hhm krb5kdc[4013](info): commencing operation
krb5kdc: starting...
W20260811 15:01:05.511322 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:01:05 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:01:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:01:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:01:05.644281 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:05.760573 4030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:05.760883 4030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:05.760967 4030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:05.764932 4030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:05.765019 4030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:05.765059 4030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:05.765116 4030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:05.765156 4030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:05.770371 4030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:05.771420 4030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:05.772502 4030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:05.781107 4040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:05.781116 4035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:05.781356 4030 server_base.cc:1034] running on GCE node
W20260811 15:01:05.781147 4036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:05.782090 4030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:05.783200 4030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:05.784401 4030 hybrid_clock.cc:648] HybridClock initialized: now 1786460465784394 us; error 51 us; skew 500 ppm
Aug 11 15:01:05 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:05.787354 4030 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:05.788286 4030 webserver.cc:460] Webserver started at http://127.11.225.126:45919/ using document root <none> and password file <none>
I20260811 15:01:05.788864 4030 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:05.788960 4030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:05.789207 4030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:05.791363 4030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "9405661f3ded478db72ba27380388a68"
format_stamp: "Formatted at 2026-08-11 15:01:05 on dist-test-slave-8hhm"
server_key: "1d1348080dd9a4f29430be151cc19398"
server_key_iv: "d4c704d91e5eea1582d75ddb3f63e986"
server_key_version: "encryptionkey@0"
I20260811 15:01:05.791981 4030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "9405661f3ded478db72ba27380388a68"
format_stamp: "Formatted at 2026-08-11 15:01:05 on dist-test-slave-8hhm"
server_key: "1d1348080dd9a4f29430be151cc19398"
server_key_iv: "d4c704d91e5eea1582d75ddb3f63e986"
server_key_version: "encryptionkey@0"
I20260811 15:01:05.796746 4030 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 15:01:05.799228 4055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:05.800429 4030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:05.800588 4030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "9405661f3ded478db72ba27380388a68"
format_stamp: "Formatted at 2026-08-11 15:01:05 on dist-test-slave-8hhm"
server_key: "1d1348080dd9a4f29430be151cc19398"
server_key_iv: "d4c704d91e5eea1582d75ddb3f63e986"
server_key_version: "encryptionkey@0"
I20260811 15:01:05.800705 4030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:05.815271 4030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:05.818357 4030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:05.818567 4030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:05.825860 4030 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41529
I20260811 15:01:05.826221 4135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41529 every 8 connection(s)
I20260811 15:01:05.826881 4030 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:05.829967 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:05.832231 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 4030
I20260811 15:01:05.832394 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:01:05.832695 12165 external_mini_cluster.cc:1428] Setting key 3739622227f38ed8be1a943f36ebb9b2
I20260811 15:01:05.836813 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap starting.
I20260811 15:01:05.839740 4136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:05.840731 4136 log.cc:824] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:05.842809 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: No bootstrap required, opened a new log
Aug 11 15:01:05 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:05.847124 4136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:05.847432 4136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:05.847563 4136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9405661f3ded478db72ba27380388a68, State: Initialized, Role: FOLLOWER
I20260811 15:01:05.848109 4136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:05.848276 4136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:05.848366 4136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:05.848491 4136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:05.849150 4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:05.834268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59946 (local address 127.11.225.126:41529)
0811 15:01:05.834749 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:05.834771 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:05.834817 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:01:05.835701 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:05.835729 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:05.836147 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:05.836529 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:05.837387 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:05.838870 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:05.839762 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:05.840496 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:05.840683 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:05.843577 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:05.843583 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:05.843597 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:05.843626 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:05.845779 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:05.846307 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:05.846311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:05.846316 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:05.846442 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:05.846800 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:05.846803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:05.846804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:05.847229 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:05.847475 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:05.847796 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 15:01:05.848224 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":124,"threads_started":1}
I20260811 15:01:05.849586 4136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:05.849946 4136 leader_election.cc:302] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9405661f3ded478db72ba27380388a68; no voters:
I20260811 15:01:05.850306 4136 leader_election.cc:288] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:01:05.850438 4143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:05.850689 4143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 LEADER]: Becoming Leader. State: Replica: 9405661f3ded478db72ba27380388a68, State: Running, Role: LEADER
I20260811 15:01:05.851104 4143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:05.851755 4136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:05.852445 4145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:05.852655 4145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:05.852458 4143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9405661f3ded478db72ba27380388a68. Latest consensus state: current_term: 1 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:05.852831 4143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:05.853188 4154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:05.856467 4154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:05.862109 4154 catalog_manager.cc:1347] Generated new cluster ID: c4339c19e69142118c0e9577440aa2e5
I20260811 15:01:05.862187 4154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:05.886153 4154 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:01:05.887527 4154 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:05.893312 4154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Generated new TSK 0
I20260811 15:01:05.894135 4154 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:01:05.926126 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:06.041832 4178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:06.042232 4178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:06.042279 4178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:06.046277 4178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:06.046332 4178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:06.046389 4178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:01:06.051496 4178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:06.052598 4178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:06.053730 4178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:06.063795 4190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:06.063795 4184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.063985 4178 server_base.cc:1034] running on GCE node
W20260811 15:01:06.063792 4185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.064529 4178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:06.065199 4178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:06.066424 4178 hybrid_clock.cc:648] HybridClock initialized: now 1786460466066406 us; error 29 us; skew 500 ppm
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:06.069403 4178 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:01:06.070324 4178 webserver.cc:460] Webserver started at http://127.11.225.65:38303/ using document root <none> and password file <none>
I20260811 15:01:06.070894 4178 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:06.070955 4178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:06.071174 4178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:06.073316 4178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "23bc6a435c03468296d68b5e753fd7a8"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "ef8818a0ea4dfbdb5e3d2c638eb755fe"
server_key_iv: "38aa6dcffb4d848bae1a1c43405fa896"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.073899 4178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "23bc6a435c03468296d68b5e753fd7a8"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "ef8818a0ea4dfbdb5e3d2c638eb755fe"
server_key_iv: "38aa6dcffb4d848bae1a1c43405fa896"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.077554 4178 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:06.080027 4206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.081431 4178 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:01:06.081593 4178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "23bc6a435c03468296d68b5e753fd7a8"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "ef8818a0ea4dfbdb5e3d2c638eb755fe"
server_key_iv: "38aa6dcffb4d848bae1a1c43405fa896"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.081715 4178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:06.095546 4178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:06.098675 4178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:06.098892 4178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:06.099556 4178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:06.100450 4178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:06.100539 4178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.100638 4178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:06.100695 4178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.110937 4178 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:38929
I20260811 15:01:06.110973 4414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:38929 every 8 connection(s)
I20260811 15:01:06.111948 4178 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:01:06.113137 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 4178
I20260811 15:01:06.113310 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:01:06.113663 12165 external_mini_cluster.cc:1428] Setting key c5a2328ac067d1f174170649a49d7fd4
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 15:01:06.127287 4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.114161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:48459 (local address 127.11.225.126:41529)
0811 15:01:06.114308 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.114313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.115288 (+ 975us) server_negotiation.cc:407] Connection header received
0811 15:01:06.116686 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.116690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.116743 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.116864 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:06.118174 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.118713 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.119878 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.120119 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.120236 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.123224 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:06.123232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:06.123234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:06.123259 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:06.124952 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.125642 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.125645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.125647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.125738 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.126116 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.126119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.126121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.126313 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:06.126427 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.126954 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.127099 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 15:01:06.128329 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.114582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:48459)
0811 15:01:06.115133 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.115194 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.116463 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.117053 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.117061 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.117515 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:06.118006 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.118021 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.118846 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.118850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.119745 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.119755 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.120279 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.120283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.120457 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.121104 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:06.121121 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:06.123040 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:06.125149 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.125155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.125172 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.125528 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.125840 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.125843 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.125845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.125996 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.126427 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:06.126435 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:06.126699 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.126894 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.127231 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":128,"threads_started":1}
I20260811 15:01:06.129756 4415 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:06.130059 4415 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:06.130574 4415 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:06.132158 4084 ts_manager.cc:194] Registered new tserver with Master: 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929)
I20260811 15:01:06.133404 4084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:48459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:01:06.144563 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:06.259825 4424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:06.260079 4424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:06.260121 4424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:06.264063 4424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:06.264118 4424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:06.264173 4424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:01:06.269198 4424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:06.270205 4424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:06.271227 4424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:06.281029 4438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.281101 4424 server_base.cc:1034] running on GCE node
W20260811 15:01:06.280983 4443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:06.281267 4436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.281683 4424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:06.282333 4424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:06.283526 4424 hybrid_clock.cc:648] HybridClock initialized: now 1786460466283491 us; error 48 us; skew 500 ppm
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:06.286465 4424 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:01:06.287384 4424 webserver.cc:460] Webserver started at http://127.11.225.66:33981/ using document root <none> and password file <none>
I20260811 15:01:06.288002 4424 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:06.288100 4424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:06.288352 4424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:06.290526 4424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "c33ebcfd4c2d42af80c2688942edec3e"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "618d8f70816efab6e6fc0f25fc282ee9"
server_key_iv: "01ee95c31ad90533b0d1bfd07a1e76b5"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.291153 4424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "c33ebcfd4c2d42af80c2688942edec3e"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "618d8f70816efab6e6fc0f25fc282ee9"
server_key_iv: "01ee95c31ad90533b0d1bfd07a1e76b5"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.295157 4424 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:01:06.297814 4457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.299223 4424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:01:06.299360 4424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c33ebcfd4c2d42af80c2688942edec3e"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "618d8f70816efab6e6fc0f25fc282ee9"
server_key_iv: "01ee95c31ad90533b0d1bfd07a1e76b5"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.299494 4424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:06.318220 4424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:06.321274 4424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:06.321511 4424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:06.322079 4424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:06.322867 4424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:06.322913 4424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.322953 4424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:06.322968 4424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.332077 4424 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:36129
I20260811 15:01:06.332113 4667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:36129 every 8 connection(s)
I20260811 15:01:06.333011 4424 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:01:06.341995 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 4424
I20260811 15:01:06.342161 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:01:06.342479 12165 external_mini_cluster.cc:1428] Setting key 4ba7a55aab44d09cccd6250fd60204c3
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:06.347922 4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.334931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:36883 (local address 127.11.225.126:41529)
0811 15:01:06.335137 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.335142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.335891 (+ 749us) server_negotiation.cc:407] Connection header received
0811 15:01:06.337511 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.337515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.337576 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.337681 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:06.338931 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.339478 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.340629 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.340908 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.341023 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.343962 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:06.343966 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:06.343970 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:06.344039 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:06.345613 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.346138 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.346142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.346144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.346252 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.346628 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.346633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.346637 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.346901 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:06.347021 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.347538 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.347689 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 15:01:06.348625 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.335240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:36883)
0811 15:01:06.335734 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.335779 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.337293 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.337891 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.337898 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.338293 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:06.338772 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.338785 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.339608 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.339611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.340488 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.340498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.341069 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.341073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.341303 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.341949 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:06.341965 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:06.343771 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:06.345736 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.345742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.345757 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.346030 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.346369 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.346372 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.346374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.346521 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.347049 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:06.347054 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:06.347287 (+ 233us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.347443 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.347697 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":136,"threads_started":1}
I20260811 15:01:06.349813 4670 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:06.350080 4670 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:06.350739 4670 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:06.352258 4084 ts_manager.cc:194] Registered new tserver with Master: c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
I20260811 15:01:06.352919 4084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:36883
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:01:06.374495 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:06.488965 4676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:06.489267 4676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:06.489378 4676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:06.493417 4676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:06.493491 4676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:06.493582 4676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:01:06.498721 4676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:06.499835 4676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:06.500890 4676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:06.510730 4684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:06.510736 4683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.510775 4676 server_base.cc:1034] running on GCE node
W20260811 15:01:06.510740 4691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:06.511433 4676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:06.512104 4676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:06.513288 4676 hybrid_clock.cc:648] HybridClock initialized: now 1786460466513267 us; error 38 us; skew 500 ppm
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:06.516132 4676 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:01:06.517036 4676 webserver.cc:460] Webserver started at http://127.11.225.67:46815/ using document root <none> and password file <none>
I20260811 15:01:06.517616 4676 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:06.517679 4676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:06.517848 4676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:06.519779 4676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "b46dcde57c21741b9d4970c1a37687aa"
server_key_iv: "8c00ebb57b7c0a4fa8cce0ce66e3ab05"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.520300 4676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "b46dcde57c21741b9d4970c1a37687aa"
server_key_iv: "8c00ebb57b7c0a4fa8cce0ce66e3ab05"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.523937 4676 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 15:01:06.526286 4701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.527511 4676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:01:06.527627 4676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "b46dcde57c21741b9d4970c1a37687aa"
server_key_iv: "8c00ebb57b7c0a4fa8cce0ce66e3ab05"
server_key_version: "encryptionkey@0"
I20260811 15:01:06.527706 4676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:06.540235 4676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:06.543464 4676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:06.543644 4676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:06.544162 4676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:06.544963 4676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:06.545009 4676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.545048 4676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:06.545063 4676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:06.554642 4676 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37099
I20260811 15:01:06.554700 4911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37099 every 8 connection(s)
I20260811 15:01:06.555635 4676 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:01:06.561992 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 4676
I20260811 15:01:06.562129 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:01:06.562459 12165 external_mini_cluster.cc:1428] Setting key 9e47e7cf560b5e31b7635aeb895cad80
Aug 11 15:01:06 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460466, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:06.569622 4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.557487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:55271 (local address 127.11.225.126:41529)
0811 15:01:06.557636 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.557640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.558484 (+ 844us) server_negotiation.cc:407] Connection header received
0811 15:01:06.559846 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.559848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.559895 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.559970 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:06.561157 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.561745 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.563406 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.563700 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.563801 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.566404 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:06.566407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:06.566409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:06.566433 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:06.567656 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.568128 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.568131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.568133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.568214 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.568580 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.568583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.568584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.568756 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:06.568833 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.569381 (+ 548us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.569488 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:01:06.570411 4918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.557890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:55271)
0811 15:01:06.558327 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.558371 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.559646 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.560169 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.560175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.560528 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:06.561002 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.561026 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.561874 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.561878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.563216 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.563226 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.563871 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.563876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.564069 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.564719 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:06.564736 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:06.566254 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:06.567757 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.567761 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.567772 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.568015 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.568332 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:06.568335 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:06.568336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:06.568477 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:06.568856 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:06.568861 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:06.569108 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.569319 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.569591 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":109,"threads_started":1}
I20260811 15:01:06.571586 4912 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:06.571892 4912 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:06.572443 4912 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:06.573580 4084 ts_manager.cc:194] Registered new tserver with Master: ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099)
I20260811 15:01:06.574160 4084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:55271
I20260811 15:01:06.576279 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:01:06.586328 4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.578418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59956 (local address 127.11.225.126:41529)
0811 15:01:06.578557 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.578563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.578758 (+ 195us) server_negotiation.cc:407] Connection header received
0811 15:01:06.578917 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.578924 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.578962 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.579041 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:06.579799 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.580315 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.581194 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.581571 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.581677 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.583060 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:06.583064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:06.583066 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:06.583091 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:06.584466 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.584891 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.584894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.584896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.584981 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:06.585303 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:06.585307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:06.585309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:06.585630 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:06.585802 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.586058 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.586169 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:01:06.589030 4084 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:01:06.592051 4084 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:01:06.607050 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.601713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41206 (local address 127.11.225.65:38929)
0811 15:01:06.602054 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.602072 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.602102 (+ 30us) server_negotiation.cc:407] Connection header received
0811 15:01:06.602164 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.602167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.602306 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.602459 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:06.602993 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.604270 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.605683 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606310 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606453 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.606607 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.606770 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.606863 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":119,"threads_started":1}
I20260811 15:01:06.607179 4931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.600477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:36129 (local address 127.0.0.1:51858)
0811 15:01:06.601420 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.601470 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.601623 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.602418 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.602424 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.602446 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:06.602611 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.602622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.604225 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.604228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.605648 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.605659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606710 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.606854 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.606875 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.606938 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.607036 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":151,"spinlock_wait_cycles":7296,"thread_start_us":114,"threads_started":1}
I20260811 15:01:06.607311 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.601342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51858 (local address 127.11.225.66:36129)
0811 15:01:06.601925 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.601937 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.601960 (+ 23us) server_negotiation.cc:407] Connection header received
0811 15:01:06.602039 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.602046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.602252 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.602404 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:06.602795 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.604074 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.605754 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606573 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606844 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.606987 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.607056 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.607146 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":105,"threads_started":1}
I20260811 15:01:06.607688 4935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.600385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37099 (local address 127.0.0.1:46354)
0811 15:01:06.601419 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.601470 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.601622 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.602630 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.602636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.602653 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:06.602831 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.602838 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.604026 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.604029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.605385 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.605396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606714 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.607369 (+ 653us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.607396 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.607477 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.607549 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":102,"spinlock_wait_cycles":1664,"thread_start_us":106,"threads_started":1}
I20260811 15:01:06.607753 4934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.600516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46354 (local address 127.11.225.67:37099)
0811 15:01:06.602172 (+ 1656us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.602183 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.602201 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:01:06.602271 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.602276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.602435 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.602572 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:06.602951 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.603880 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.605519 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606394 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606515 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.606664 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.607522 (+ 858us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.607619 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1564,"thread_start_us":201,"threads_started":1}
I20260811 15:01:06.607965 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.600816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:38929 (local address 127.0.0.1:41206)
0811 15:01:06.601851 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.601885 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.601964 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.602701 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.602706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.602731 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:06.602864 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.602870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.604406 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.604409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.605552 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.605563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.606453 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.606457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.606568 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.606605 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.606739 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.606858 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"mutex_wait_us":52,"thread_start_us":97,"threads_started":1}
I20260811 15:01:06.610399 4788 tablet_service.cc:1467] Processing CreateTablet for tablet 10cd8988abd747af8c09ac6c7dab986a (DEFAULT_TABLE table=test-table [id=05065b04754a4061b3d09b77a2bcadb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:06.610514 4292 tablet_service.cc:1467] Processing CreateTablet for tablet 10cd8988abd747af8c09ac6c7dab986a (DEFAULT_TABLE table=test-table [id=05065b04754a4061b3d09b77a2bcadb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:06.610514 4541 tablet_service.cc:1467] Processing CreateTablet for tablet 10cd8988abd747af8c09ac6c7dab986a (DEFAULT_TABLE table=test-table [id=05065b04754a4061b3d09b77a2bcadb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:06.611541 4292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10cd8988abd747af8c09ac6c7dab986a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:06.611549 4541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10cd8988abd747af8c09ac6c7dab986a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:06.611544 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10cd8988abd747af8c09ac6c7dab986a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:06.618661 4942 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Bootstrap starting.
I20260811 15:01:06.619170 4943 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Bootstrap starting.
I20260811 15:01:06.620716 4942 tablet_bootstrap.cc:654] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:06.621346 4943 tablet_bootstrap.cc:654] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:06.622130 4942 log.cc:824] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:06.622233 4943 log.cc:824] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:06.622951 4945 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap starting.
I20260811 15:01:06.624285 4943 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: No bootstrap required, opened a new log
I20260811 15:01:06.624285 4942 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: No bootstrap required, opened a new log
I20260811 15:01:06.624492 4942 ts_tablet_manager.cc:1397] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:01:06.624492 4943 ts_tablet_manager.cc:1397] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:01:06.624810 4945 tablet_bootstrap.cc:654] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:06.625909 4945 log.cc:824] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:06.627580 4945 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: No bootstrap required, opened a new log
I20260811 15:01:06.627779 4945 ts_tablet_manager.cc:1397] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:01:06.628444 4942 raft_consensus.cc:348] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.628444 4943 raft_consensus.cc:348] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.628712 4942 raft_consensus.cc:374] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:06.628712 4943 raft_consensus.cc:374] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:06.628765 4943 raft_consensus.cc:729] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33ebcfd4c2d42af80c2688942edec3e, State: Initialized, Role: FOLLOWER
I20260811 15:01:06.628773 4942 raft_consensus.cc:729] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae089f38529d4b389ff0bf9dcfc7946d, State: Initialized, Role: FOLLOWER
I20260811 15:01:06.629274 4943 consensus_queue.cc:260] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.629274 4942 consensus_queue.cc:260] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.630295 4943 ts_tablet_manager.cc:1428] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:01:06.630295 4942 ts_tablet_manager.cc:1428] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:01:06.630668 4670 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
I20260811 15:01:06.630681 4912 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
I20260811 15:01:06.631922 4945 raft_consensus.cc:348] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.632211 4945 raft_consensus.cc:374] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:06.632272 4945 raft_consensus.cc:729] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bc6a435c03468296d68b5e753fd7a8, State: Initialized, Role: FOLLOWER
I20260811 15:01:06.632690 4945 consensus_queue.cc:260] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.633433 4415 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
I20260811 15:01:06.633750 4945 ts_tablet_manager.cc:1428] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260811 15:01:06.806634 4914 tablet.cc:2369] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:01:06.834226 4671 tablet.cc:2369] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:06.843320 4952 raft_consensus.cc:482] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:06.843566 4952 raft_consensus.cc:504] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.844918 4952 leader_election.cc:288] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129), 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929)
I20260811 15:01:06.848829 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.845525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:50773 (local address 127.11.225.65:38929)
0811 15:01:06.845697 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.845701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.845716 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:01:06.845772 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.845776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.845832 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.845928 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:06.846244 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.846771 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.847816 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.848204 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.848333 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.848406 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.848606 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.848692 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 15:01:06.848845 4918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.845216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:38929 (local address 127.11.225.67:50773)
0811 15:01:06.845354 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.845372 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.845473 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.845941 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.845944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.845961 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:06.846112 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.846118 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.846894 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.846900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.847681 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.847690 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.848334 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.848337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.848449 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.848496 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.848587 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.848659 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":2}
I20260811 15:01:06.848860 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.845334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:53361 (local address 127.11.225.66:36129)
0811 15:01:06.845489 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.845495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.845769 (+ 274us) server_negotiation.cc:407] Connection header received
0811 15:01:06.845922 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.845927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.845977 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.846062 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:06.846363 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.846849 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.847870 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.848259 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.848389 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.848444 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.848661 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.848730 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:01:06.848889 4958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.845221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:36129 (local address 127.11.225.67:53361)
0811 15:01:06.845675 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.845687 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:06.845807 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:06.846097 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:06.846100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:06.846117 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:06.846246 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.846251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.846970 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.846973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.847745 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:06.847753 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.848383 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.848387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:06.848533 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.848554 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:01:06.848643 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:01:06.848709 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":75,"thread_start_us":155,"threads_started":1}
I20260811 15:01:06.849519 4580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10cd8988abd747af8c09ac6c7dab986a" candidate_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33ebcfd4c2d42af80c2688942edec3e" is_pre_election: true
I20260811 15:01:06.849576 4330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10cd8988abd747af8c09ac6c7dab986a" candidate_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23bc6a435c03468296d68b5e753fd7a8" is_pre_election: true
I20260811 15:01:06.849839 4580 raft_consensus.cc:2454] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae089f38529d4b389ff0bf9dcfc7946d in term 0.
I20260811 15:01:06.849954 4330 raft_consensus.cc:2454] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae089f38529d4b389ff0bf9dcfc7946d in term 0.
I20260811 15:01:06.850318 4704 leader_election.cc:302] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e; no voters:
I20260811 15:01:06.850596 4952 raft_consensus.cc:2781] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:01:06.850704 4952 raft_consensus.cc:482] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:01:06.850754 4952 raft_consensus.cc:3037] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:06.853914 4952 raft_consensus.cc:504] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.855397 4330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10cd8988abd747af8c09ac6c7dab986a" candidate_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23bc6a435c03468296d68b5e753fd7a8"
I20260811 15:01:06.855576 4330 raft_consensus.cc:3037] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:06.856027 4580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10cd8988abd747af8c09ac6c7dab986a" candidate_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33ebcfd4c2d42af80c2688942edec3e"
I20260811 15:01:06.856184 4580 raft_consensus.cc:3037] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:06.857270 4330 raft_consensus.cc:2454] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae089f38529d4b389ff0bf9dcfc7946d in term 1.
I20260811 15:01:06.857720 4580 raft_consensus.cc:2454] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae089f38529d4b389ff0bf9dcfc7946d in term 1.
I20260811 15:01:06.857786 4702 leader_election.cc:302] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8, ae089f38529d4b389ff0bf9dcfc7946d; no voters:
I20260811 15:01:06.858049 4952 leader_election.cc:288] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [CANDIDATE]: Term 1 election: Requested vote from peers c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129), 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929)
I20260811 15:01:06.858235 4952 raft_consensus.cc:2781] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:06.858336 4952 raft_consensus.cc:686] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 1 LEADER]: Becoming Leader. State: Replica: ae089f38529d4b389ff0bf9dcfc7946d, State: Running, Role: LEADER
I20260811 15:01:06.858736 4952 consensus_queue.cc:237] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:06.862783 4077 catalog_manager.cc:5495] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d reported cstate change: term changed from 0 to 1, leader changed from <none> to ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67). New cstate: current_term: 1 leader_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } health_report { overall_health: UNKNOWN } } }
W20260811 15:01:06.863384 4416 tablet.cc:2369] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:06.899461 4934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.895752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.11.225.67:37099)
0811 15:01:06.895928 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:06.895935 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:06.895955 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:01:06.896031 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:06.896039 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:06.896094 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:06.896209 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:06.896474 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.896982 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.897945 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:06.898164 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:06.898273 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:06.898594 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:06.899026 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:01:06.899174 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:06.899219 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 15:01:06.899275 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:01:06.906281 4330 raft_consensus.cc:1261] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Refusing update from remote peer ae089f38529d4b389ff0bf9dcfc7946d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:06.906381 4580 raft_consensus.cc:1261] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Refusing update from remote peer ae089f38529d4b389ff0bf9dcfc7946d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:06.907081 4960 consensus_queue.cc:1035] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:06.907402 4952 consensus_queue.cc:1035] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:06.926218 4968 mvcc.cc:205] Tried to move back new op lower bound from 7317342072439177216 to 7317342072256630784. Current Snapshot: MvccSnapshot[applied={T|T < 7317342072439177216}]
I20260811 15:01:06.927145 4077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:06.927321 4077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:06.930207 4077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Sending DeleteTablet for 3 replicas of tablet 10cd8988abd747af8c09ac6c7dab986a
I20260811 15:01:06.931071 4541 tablet_service.cc:1514] Processing DeleteTablet for tablet 10cd8988abd747af8c09ac6c7dab986a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:06 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:51858
I20260811 15:01:06.931068 4788 tablet_service.cc:1514] Processing DeleteTablet for tablet 10cd8988abd747af8c09ac6c7dab986a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:06 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:46354
I20260811 15:01:06.931327 4292 tablet_service.cc:1514] Processing DeleteTablet for tablet 10cd8988abd747af8c09ac6c7dab986a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:06 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:41206
I20260811 15:01:06.931898 4985 tablet_replica.cc:330] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: stopping tablet replica
I20260811 15:01:06.932071 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 4178
I20260811 15:01:06.945513 4984 tablet_replica.cc:330] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: stopping tablet replica
I20260811 15:01:06.946043 4984 raft_consensus.cc:2229] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:06.946563 4984 raft_consensus.cc:2258] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:06.948415 4984 ts_tablet_manager.cc:1905] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:06.952052 4984 ts_tablet_manager.cc:1918] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:06.952176 4984 log.cc:1196] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/10cd8988abd747af8c09ac6c7dab986a
I20260811 15:01:06.952561 4984 ts_tablet_manager.cc:1939] T 10cd8988abd747af8c09ac6c7dab986a P c33ebcfd4c2d42af80c2688942edec3e: Deleting consensus metadata
I20260811 15:01:06.954344 4059 catalog_manager.cc:4841] TS c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): tablet 10cd8988abd747af8c09ac6c7dab986a (table test-table [id=05065b04754a4061b3d09b77a2bcadb1]) successfully deleted
W20260811 15:01:06.955761 4056 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:38929 (error 108)
I20260811 15:01:06.956928 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 4424
I20260811 15:01:06.957023 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:06.956634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:38929 (local address 127.0.0.1:41210)
0811 15:01:06.956816 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:06.956904 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:38929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 15:01:06.964988 4056 catalog_manager.cc:4584] TS 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10cd8988abd747af8c09ac6c7dab986a: Network error: Client connection negotiation failed: client connection to 127.11.225.65:38929: connect: Connection refused (error 111)
I20260811 15:01:06.965466 4983 tablet_replica.cc:330] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: stopping tablet replica
I20260811 15:01:06.965883 4983 raft_consensus.cc:2229] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:01:06.966365 4983 raft_consensus.cc:2258] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:06.968096 4983 ts_tablet_manager.cc:1905] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:06.971009 4983 ts_tablet_manager.cc:1918] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:06.971102 4983 log.cc:1196] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/10cd8988abd747af8c09ac6c7dab986a
I20260811 15:01:06.971431 4983 ts_tablet_manager.cc:1939] T 10cd8988abd747af8c09ac6c7dab986a P ae089f38529d4b389ff0bf9dcfc7946d: Deleting consensus metadata
I20260811 15:01:06.972889 4058 catalog_manager.cc:4841] TS ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): tablet 10cd8988abd747af8c09ac6c7dab986a (table test-table [id=05065b04754a4061b3d09b77a2bcadb1]) successfully deleted
I20260811 15:01:06.974625 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 4676
I20260811 15:01:06.994292 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 4030
I20260811 15:01:07.006820 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--webserver_interface=127.11.225.126
--webserver_port=45919
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:07.120400 4987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:07.120657 4987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:07.120697 4987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:07.125406 4987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:07.125464 4987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:07.125484 4987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:07.125500 4987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:07.125516 4987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:07.130749 4987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=45919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:07.131805 4987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:07.132838 4987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:07.147060 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:07.147257 4987 server_base.cc:1034] running on GCE node
W20260811 15:01:07.147027 4999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.147027 4996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:07.148094 4987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:07.149274 4987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:07.150446 4987 hybrid_clock.cc:648] HybridClock initialized: now 1786460467150438 us; error 36 us; skew 500 ppm
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:07.153578 4987 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:07.154552 4987 webserver.cc:460] Webserver started at http://127.11.225.126:45919/ using document root <none> and password file <none>
I20260811 15:01:07.155109 4987 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:07.155186 4987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:07.159245 4987 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:07.161692 5016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.163064 4987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:01:07.163218 4987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "9405661f3ded478db72ba27380388a68"
format_stamp: "Formatted at 2026-08-11 15:01:05 on dist-test-slave-8hhm"
server_key: "1d1348080dd9a4f29430be151cc19398"
server_key_iv: "d4c704d91e5eea1582d75ddb3f63e986"
server_key_version: "encryptionkey@0"
I20260811 15:01:07.163853 4987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:07.180038 4987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:07.183074 4987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:07.183277 4987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:07.190944 4987 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41529
I20260811 15:01:07.191253 5110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41529 every 8 connection(s)
I20260811 15:01:07.192106 4987 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:07.193827 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 4987
I20260811 15:01:07.194357 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:38929
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=38303
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:07.197784 5112 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:01:07.199594 5112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap starting.
I20260811 15:01:07.217016 5112 log.cc:824] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:07.225742 5112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:07.226118 5112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap complete.
I20260811 15:01:07.230386 5112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:07.230757 5112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9405661f3ded478db72ba27380388a68, State: Initialized, Role: FOLLOWER
I20260811 15:01:07.231282 5112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:07.231401 5112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:07.231493 5112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:07.231632 5112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:01:07.233601 5112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:07.233935 5112 leader_election.cc:302] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9405661f3ded478db72ba27380388a68; no voters:
I20260811 15:01:07.234282 5112 leader_election.cc:288] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:01:07.234386 5116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:01:07.234606 5116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 LEADER]: Becoming Leader. State: Replica: 9405661f3ded478db72ba27380388a68, State: Running, Role: LEADER
I20260811 15:01:07.234890 5116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:07.235493 5112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:07.235810 5116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9405661f3ded478db72ba27380388a68. Latest consensus state: current_term: 2 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:07.235953 5116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:07.236318 5124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:07.236356 5118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:07.236574 5118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:07.241148 5124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:07.242008 5124 catalog_manager.cc:1259] Loaded cluster ID: c4339c19e69142118c0e9577440aa2e5
I20260811 15:01:07.242134 5124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:07.243645 5124 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 15:01:07.248657 5124 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 15:01:07.254407 5124 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:07.256156 5124 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Loaded TSK: 0
I20260811 15:01:07.257576 5124 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:01:07.323833 5114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:07.324131 5114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:07.324214 5114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:07.328227 5114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:07.328313 5114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:07.328405 5114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:01:07.333678 5114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:38929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=38303
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:07.334741 5114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:07.335865 5114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:07.346117 5152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.346194 5155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.346125 5153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:07.346506 5114 server_base.cc:1034] running on GCE node
I20260811 15:01:07.346948 5114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:07.347656 5114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:07.348837 5114 hybrid_clock.cc:648] HybridClock initialized: now 1786460467348805 us; error 46 us; skew 500 ppm
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:07.351747 5114 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:01:07.352697 5114 webserver.cc:460] Webserver started at http://127.11.225.65:38303/ using document root <none> and password file <none>
I20260811 15:01:07.353312 5114 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:07.353394 5114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:07.357666 5114 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:01:07.359794 5172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.361079 5114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:07.361171 5114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "23bc6a435c03468296d68b5e753fd7a8"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "ef8818a0ea4dfbdb5e3d2c638eb755fe"
server_key_iv: "38aa6dcffb4d848bae1a1c43405fa896"
server_key_version: "encryptionkey@0"
I20260811 15:01:07.361846 5114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:07.371392 5114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:07.374471 5114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:07.374670 5114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:07.375329 5114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:07.376557 5185 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:01:07.380985 5114 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:01:07.381047 5114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 15:01:07.381093 5114 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:01:07.382865 5114 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:01:07.382922 5114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:01:07.383196 5185 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap starting.
I20260811 15:01:07.393812 5114 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:38929
I20260811 15:01:07.393977 5376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:38929 every 8 connection(s)
I20260811 15:01:07.395048 5114 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:01:07.402431 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 5114
I20260811 15:01:07.402897 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:36129
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=33981
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:07.404347 5185 log.cc:824] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:07.413196 5185 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:07.413671 5185 tablet_bootstrap.cc:492] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap complete.
I20260811 15:01:07.414847 5185 ts_tablet_manager.cc:1397] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.013s
I20260811 15:01:07.414956 5385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.397537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:36697)
0811 15:01:07.398121 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.398165 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.399005 (+ 840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.400277 (+ 1272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.400284 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.400727 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:07.401188 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.401202 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.402698 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.402702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.403983 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.403995 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.405103 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.405109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.405376 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.406167 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:07.406191 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:07.408032 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:07.410887 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.410896 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.410931 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.411341 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.411815 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.411821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.411824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.412026 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.412774 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:07.412784 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:07.413117 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.413360 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.413768 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":151,"threads_started":1}
I20260811 15:01:07.416973 5383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.397499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36697 (local address 127.11.225.126:41529)
0811 15:01:07.397850 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.397867 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.398297 (+ 430us) server_negotiation.cc:407] Connection header received
0811 15:01:07.399461 (+ 1164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.399477 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.399886 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.400230 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:07.401435 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.402528 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.404136 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.404929 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.405110 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.408268 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:07.408280 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:07.408303 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:07.408350 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:07.410729 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.411501 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.411508 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.411513 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.411680 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.412157 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.412160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.412162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.412613 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:07.412765 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.415687 (+ 2922us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.416026 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":114,"threads_started":1}
I20260811 15:01:07.417336 5185 raft_consensus.cc:348] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.417788 5185 raft_consensus.cc:729] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bc6a435c03468296d68b5e753fd7a8, State: Initialized, Role: FOLLOWER
I20260811 15:01:07.418345 5185 consensus_queue.cc:260] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.419268 5185 ts_tablet_manager.cc:1428] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 15:01:07.419445 5377 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:07.419698 5377 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:07.420231 5377 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:07.422864 5046 ts_manager.cc:194] Registered new tserver with Master: 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929)
I20260811 15:01:07.426216 5046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:36697
I20260811 15:01:07.428889 5377 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 15:01:07.436131 5393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.425618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:38929 (local address 127.0.0.1:41214)
0811 15:01:07.426330 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.426373 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.426510 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.427026 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.427032 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.427424 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:07.427523 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.427530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.428483 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.428486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.429169 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.429179 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.430069 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.430072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.430182 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.430754 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:07.430766 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:07.432108 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:07.434244 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.434253 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.434258 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.434527 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.434866 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.434869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.434871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.434959 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.435507 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:07.435513 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:07.435627 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.435766 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.435950 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":103,"threads_started":1}
I20260811 15:01:07.436143 5394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.425697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41214 (local address 127.11.225.65:38929)
0811 15:01:07.426052 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.426062 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.426479 (+ 417us) server_negotiation.cc:407] Connection header received
0811 15:01:07.426665 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.426671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.426884 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.427021 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:07.427666 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.428363 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.429405 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.429915 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.430037 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.432257 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:07.432267 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:07.432280 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:07.432306 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:07.434124 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.434676 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.434681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.434682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.434764 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.435058 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.435062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.435064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.435297 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:07.435522 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.435852 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.436008 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":97,"threads_started":1}
I20260811 15:01:07.437346 5248 tablet_service.cc:1514] Processing DeleteTablet for tablet 10cd8988abd747af8c09ac6c7dab986a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:06 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:41214
I20260811 15:01:07.438342 5396 tablet_replica.cc:330] stopping tablet replica
I20260811 15:01:07.438655 5396 raft_consensus.cc:2229] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:07.438925 5396 raft_consensus.cc:2258] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:07.440058 5396 ts_tablet_manager.cc:1905] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:07.444528 5396 ts_tablet_manager.cc:1918] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:07.444660 5396 log.cc:1196] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/10cd8988abd747af8c09ac6c7dab986a
I20260811 15:01:07.444994 5396 ts_tablet_manager.cc:1939] T 10cd8988abd747af8c09ac6c7dab986a P 23bc6a435c03468296d68b5e753fd7a8: Deleting consensus metadata
I20260811 15:01:07.447070 5017 catalog_manager.cc:4841] TS 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929): tablet 10cd8988abd747af8c09ac6c7dab986a (table test-table [id=05065b04754a4061b3d09b77a2bcadb1]) successfully deleted
W20260811 15:01:07.528656 5386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:07.528903 5386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:07.528960 5386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:07.532925 5386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:07.532977 5386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:07.533038 5386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:01:07.538228 5386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:36129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=33981
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:07.539165 5386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:07.540138 5386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:07.550020 5410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.549981 5414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.550079 5411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:07.550436 5386 server_base.cc:1034] running on GCE node
I20260811 15:01:07.550863 5386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:07.551525 5386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:07.552711 5386 hybrid_clock.cc:648] HybridClock initialized: now 1786460467552697 us; error 27 us; skew 500 ppm
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:07.555562 5386 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:01:07.556449 5386 webserver.cc:460] Webserver started at http://127.11.225.66:33981/ using document root <none> and password file <none>
I20260811 15:01:07.557013 5386 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:07.557124 5386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:07.560849 5386 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:01:07.562899 5422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.564101 5386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:01:07.564239 5386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c33ebcfd4c2d42af80c2688942edec3e"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "618d8f70816efab6e6fc0f25fc282ee9"
server_key_iv: "01ee95c31ad90533b0d1bfd07a1e76b5"
server_key_version: "encryptionkey@0"
I20260811 15:01:07.564836 5386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:07.583290 5386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:07.586217 5386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:07.586426 5386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:07.587031 5386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:07.587846 5386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:07.587924 5386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.588001 5386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:07.588027 5386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.597692 5386 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:36129
I20260811 15:01:07.597735 5614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:36129 every 8 connection(s)
I20260811 15:01:07.598769 5386 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:01:07.601732 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 5386
I20260811 15:01:07.602288 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:37099
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=46815
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:07.615196 5383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.600550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:53107 (local address 127.11.225.126:41529)
0811 15:01:07.600731 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.600736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.601618 (+ 882us) server_negotiation.cc:407] Connection header received
0811 15:01:07.603739 (+ 2121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.603742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.603795 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.603884 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:07.605302 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.606144 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.608041 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.608325 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.608409 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.611461 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:07.611464 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:07.611466 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:07.611494 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:07.613024 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.613614 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.613617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.613618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.613693 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.614048 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.614051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.614053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.614238 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:07.614345 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.614841 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.614974 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 15:01:07.616043 5618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.600964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:53107)
0811 15:01:07.601411 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.601494 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.603472 (+ 1978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.604119 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.604130 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.604640 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:07.605120 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.605137 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.606281 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.606287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.607847 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.607861 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.608503 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.608510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.608773 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.609478 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:07.609507 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:07.611277 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:07.613144 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.613151 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.613166 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.613499 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.613791 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.613794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.613796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.613942 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.614345 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:07.614352 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:07.614603 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.614783 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.615128 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":102,"threads_started":1}
I20260811 15:01:07.617249 5615 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:07.617501 5615 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:07.618003 5615 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:07.619096 5046 ts_manager.cc:194] Registered new tserver with Master: c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
I20260811 15:01:07.619853 5046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:53107
W20260811 15:01:07.722371 5621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:07.722640 5621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:07.722682 5621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:07.726627 5621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:07.726698 5621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:07.726752 5621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:01:07.732112 5621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:37099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=46815
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:07.733144 5621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:07.734220 5621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:07.744366 5640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.744359 5632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:07.744340 5633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:07.744608 5621 server_base.cc:1034] running on GCE node
I20260811 15:01:07.745172 5621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:07.745889 5621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:07.747084 5621 hybrid_clock.cc:648] HybridClock initialized: now 1786460467747057 us; error 45 us; skew 500 ppm
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:07.749936 5621 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:01:07.750893 5621 webserver.cc:460] Webserver started at http://127.11.225.67:46815/ using document root <none> and password file <none>
I20260811 15:01:07.751488 5621 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:07.751605 5621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:07.755621 5621 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:07.757872 5650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.759152 5621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:07.759294 5621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "b46dcde57c21741b9d4970c1a37687aa"
server_key_iv: "8c00ebb57b7c0a4fa8cce0ce66e3ab05"
server_key_version: "encryptionkey@0"
I20260811 15:01:07.759866 5621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:07.778980 5621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:07.782202 5621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:07.782423 5621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:07.783064 5621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:07.783947 5621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:07.784022 5621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.784099 5621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:07.784147 5621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:07.794353 5621 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37099
I20260811 15:01:07.794373 5859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37099 every 8 connection(s)
I20260811 15:01:07.795410 5621 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:01:07.801342 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 5621
Aug 11 15:01:07 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460467, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:07.812034 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.802395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.11.225.126:41529)
0811 15:01:07.802699 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.802704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.803273 (+ 569us) server_negotiation.cc:407] Connection header received
0811 15:01:07.803408 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.803412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.803462 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.803554 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:07.804573 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.805257 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.806501 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.806858 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.806984 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.808458 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:07.808462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:07.808464 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:07.808506 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:07.810264 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.810736 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.810739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.810741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.810815 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.811108 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.811114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.811117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.811350 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:07.811559 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.811733 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.811849 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":202,"thread_start_us":67,"threads_started":1}
I20260811 15:01:07.812387 5383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.797320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:32789 (local address 127.11.225.126:41529)
0811 15:01:07.797466 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.797470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.798308 (+ 838us) server_negotiation.cc:407] Connection header received
0811 15:01:07.799767 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.799771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.799857 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.799964 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:07.801894 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.802652 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.804417 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.804724 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.804836 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.807862 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:07.807866 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:07.807869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:07.807901 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:07.809968 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.810562 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.810564 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.810566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.810640 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:07.811048 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:07.811050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:07.811052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:07.811351 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:07.811456 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.812120 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.812235 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":52,"spinlock_wait_cycles":896}
I20260811 15:01:07.813298 5863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.797684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:32789)
0811 15:01:07.798145 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.798192 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.799541 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.800202 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.800210 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.800833 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:07.801671 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.801700 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.802793 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.802795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.804275 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.804289 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.804898 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.804901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.805057 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.805707 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:07.805730 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:07.807686 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:07.810099 (+ 2413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.810104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.810116 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.810440 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.810739 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:07.810742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:07.810744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:07.810933 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:07.811465 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:07.811471 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:07.811807 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.812067 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.812389 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":108,"threads_started":1}
I20260811 15:01:07.814509 5860 heartbeater.cc:347] Connected to a master server at 127.11.225.126:41529
I20260811 15:01:07.814720 5860 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:07.815171 5860 heartbeater.cc:511] Master 127.11.225.126:41529 requested a full tablet report, sending...
I20260811 15:01:07.816154 5045 ts_manager.cc:194] Registered new tserver with Master: ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099)
I20260811 15:01:07.816713 5045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:32789
I20260811 15:01:07.826081 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:01:07.830487 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.826756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.11.225.126:41529)
0811 15:01:07.826907 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.826910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.827167 (+ 257us) server_negotiation.cc:407] Connection header received
0811 15:01:07.827267 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.827269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.827365 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.827454 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:07.827700 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.828239 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.829122 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.829422 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.829504 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.829805 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:07.830185 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:01:07.830274 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.830338 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.830388 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:01:07.831194 5045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:59976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:01:07.834453 5045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:01:07.842666 5248 tablet_service.cc:1467] Processing CreateTablet for tablet 645630a71e2f45bcabb00de262d2d146 (DEFAULT_TABLE table=test-table [id=392f10a63d0a491bb343df994f0c5475]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:07.843380 5248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 645630a71e2f45bcabb00de262d2d146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:07.846274 5185 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap starting.
I20260811 15:01:07.846629 5393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.841303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37099 (local address 127.0.0.1:46378)
0811 15:01:07.841430 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.841447 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.841526 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.842624 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.842628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.842648 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:07.842757 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.842764 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.844235 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.844238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.845410 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.845419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.846182 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.846186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.846296 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.846336 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.846403 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.846487 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 15:01:07.847196 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.841488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46378 (local address 127.11.225.67:37099)
0811 15:01:07.842056 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.842078 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.842103 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:01:07.842190 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.842199 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.842440 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.842623 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:07.842933 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.844084 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.845519 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.846055 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.846171 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.846498 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.846553 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.847049 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":191,"threads_started":1}
I20260811 15:01:07.847218 5185 tablet_bootstrap.cc:654] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:07.848426 5881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.841844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:36129 (local address 127.0.0.1:51874)
0811 15:01:07.842167 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.842180 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.842264 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.843033 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.843036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.843058 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:07.843168 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.843175 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.845043 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.845059 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.846160 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.846173 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.848016 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.848020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.848129 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.848155 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.848234 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.848300 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
I20260811 15:01:07.848847 5882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.842229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51874 (local address 127.11.225.66:36129)
0811 15:01:07.842568 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.842581 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.842601 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:01:07.842676 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.842681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.842893 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.843057 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:07.843264 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.844880 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.846411 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.847884 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.848001 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.848158 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.848262 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.848361 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":117,"threads_started":1}
I20260811 15:01:07.849341 5185 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: No bootstrap required, opened a new log
I20260811 15:01:07.849432 5185 ts_tablet_manager.cc:1397] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:07.849886 5185 raft_consensus.cc:348] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.850016 5185 raft_consensus.cc:374] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:07.850066 5185 raft_consensus.cc:729] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bc6a435c03468296d68b5e753fd7a8, State: Initialized, Role: FOLLOWER
I20260811 15:01:07.850199 5185 consensus_queue.cc:260] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.850452 5185 ts_tablet_manager.cc:1428] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:01:07.850487 5735 tablet_service.cc:1467] Processing CreateTablet for tablet 645630a71e2f45bcabb00de262d2d146 (DEFAULT_TABLE table=test-table [id=392f10a63d0a491bb343df994f0c5475]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:07.851449 5735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 645630a71e2f45bcabb00de262d2d146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:07.851388 5500 tablet_service.cc:1467] Processing CreateTablet for tablet 645630a71e2f45bcabb00de262d2d146 (DEFAULT_TABLE table=test-table [id=392f10a63d0a491bb343df994f0c5475]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:07.852298 5500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 645630a71e2f45bcabb00de262d2d146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:07.858889 5887 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Bootstrap starting.
I20260811 15:01:07.859611 5890 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Bootstrap starting.
I20260811 15:01:07.860991 5887 tablet_bootstrap.cc:654] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:07.862030 5890 tablet_bootstrap.cc:654] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:07.862246 5887 log.cc:824] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:07.862851 5890 log.cc:824] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:07.864317 5887 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: No bootstrap required, opened a new log
I20260811 15:01:07.864559 5887 ts_tablet_manager.cc:1397] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:01:07.864866 5890 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: No bootstrap required, opened a new log
I20260811 15:01:07.865094 5890 ts_tablet_manager.cc:1397] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:01:07.867774 5887 raft_consensus.cc:348] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.868072 5887 raft_consensus.cc:374] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:07.868142 5887 raft_consensus.cc:729] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae089f38529d4b389ff0bf9dcfc7946d, State: Initialized, Role: FOLLOWER
I20260811 15:01:07.868181 5890 raft_consensus.cc:348] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.868427 5890 raft_consensus.cc:374] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:07.868485 5890 raft_consensus.cc:729] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33ebcfd4c2d42af80c2688942edec3e, State: Initialized, Role: FOLLOWER
I20260811 15:01:07.868635 5887 consensus_queue.cc:260] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.868927 5890 consensus_queue.cc:260] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.869364 5860 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
I20260811 15:01:07.869634 5887 ts_tablet_manager.cc:1428] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 15:01:07.869916 5890 ts_tablet_manager.cc:1428] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260811 15:01:07.870254 5615 heartbeater.cc:503] Master 127.11.225.126:41529 was elected leader, sending a full tablet report...
W20260811 15:01:07.896692 5381 tablet.cc:2369] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:07.902941 5392 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:07.903184 5392 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.904361 5392 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
I20260811 15:01:07.908288 5385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.904554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37099 (local address 127.11.225.65:44455)
0811 15:01:07.904701 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.904719 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.904831 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.905175 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.905178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.905198 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:07.905339 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.905344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.906098 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.906102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.907070 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.907080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.907829 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.907833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.907942 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.907997 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.908079 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.908154 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 15:01:07.908304 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.904699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:44455 (local address 127.11.225.67:37099)
0811 15:01:07.904827 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.904833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.904849 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:01:07.905012 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.905015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.905062 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.905156 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:07.905457 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.905960 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.907199 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.907712 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.907802 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.907844 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.908101 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.908171 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:01:07.908598 5902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.904672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:36129 (local address 127.11.225.65:53483)
0811 15:01:07.905051 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.905062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:07.905195 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:07.905501 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:07.905504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:07.905520 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:07.905654 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.905660 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.906348 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.906353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.907386 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:07.907397 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.908140 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.908143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:07.908248 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.908271 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:01:07.908353 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 15:01:07.908445 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":121,"threads_started":1}
I20260811 15:01:07.908746 5882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.904855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53483 (local address 127.11.225.66:36129)
0811 15:01:07.904969 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.904973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.905156 (+ 183us) server_negotiation.cc:407] Connection header received
0811 15:01:07.905359 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.905361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.905406 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.905489 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:07.905775 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.906235 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.907514 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.907994 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.908121 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.908166 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.908535 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.908613 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:01:07.909129 5773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "645630a71e2f45bcabb00de262d2d146" candidate_uuid: "23bc6a435c03468296d68b5e753fd7a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" is_pre_election: true
I20260811 15:01:07.909364 5546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "645630a71e2f45bcabb00de262d2d146" candidate_uuid: "23bc6a435c03468296d68b5e753fd7a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33ebcfd4c2d42af80c2688942edec3e" is_pre_election: true
I20260811 15:01:07.909502 5773 raft_consensus.cc:2454] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23bc6a435c03468296d68b5e753fd7a8 in term 0.
I20260811 15:01:07.909689 5546 raft_consensus.cc:2454] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23bc6a435c03468296d68b5e753fd7a8 in term 0.
I20260811 15:01:07.910023 5175 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8, ae089f38529d4b389ff0bf9dcfc7946d; no voters:
I20260811 15:01:07.910316 5392 raft_consensus.cc:2781] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:01:07.910420 5392 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:01:07.910483 5392 raft_consensus.cc:3037] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:07.911553 5392 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.911931 5392 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 1 election: Requested vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
I20260811 15:01:07.912328 5546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "645630a71e2f45bcabb00de262d2d146" candidate_uuid: "23bc6a435c03468296d68b5e753fd7a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33ebcfd4c2d42af80c2688942edec3e"
I20260811 15:01:07.912328 5773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "645630a71e2f45bcabb00de262d2d146" candidate_uuid: "23bc6a435c03468296d68b5e753fd7a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
I20260811 15:01:07.912454 5773 raft_consensus.cc:3037] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:07.912454 5546 raft_consensus.cc:3037] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:07.913802 5773 raft_consensus.cc:2454] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23bc6a435c03468296d68b5e753fd7a8 in term 1.
I20260811 15:01:07.913802 5546 raft_consensus.cc:2454] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23bc6a435c03468296d68b5e753fd7a8 in term 1.
I20260811 15:01:07.914094 5175 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8, ae089f38529d4b389ff0bf9dcfc7946d; no voters:
I20260811 15:01:07.914273 5392 raft_consensus.cc:2781] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:07.914558 5392 raft_consensus.cc:686] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 LEADER]: Becoming Leader. State: Replica: 23bc6a435c03468296d68b5e753fd7a8, State: Running, Role: LEADER
I20260811 15:01:07.914817 5392 consensus_queue.cc:237] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:07.917783 5046 catalog_manager.cc:5495] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65). New cstate: current_term: 1 leader_uuid: "23bc6a435c03468296d68b5e753fd7a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260811 15:01:07.931316 5394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.927418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41230 (local address 127.11.225.65:38929)
0811 15:01:07.927577 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:07.927582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:07.927601 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:01:07.927695 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:07.927697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:07.927752 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:07.927877 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:07.928160 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.928718 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.929741 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:07.930020 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:07.930148 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:07.930444 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:07.930902 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:01:07.931054 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:07.931099 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 15:01:07.931159 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:01:07.935505 5773 raft_consensus.cc:1261] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Refusing update from remote peer 23bc6a435c03468296d68b5e753fd7a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:07.935516 5546 raft_consensus.cc:1261] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Refusing update from remote peer 23bc6a435c03468296d68b5e753fd7a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:07.936367 5903 consensus_queue.cc:1035] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:07.936596 5392 consensus_queue.cc:1035] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:07.946959 5914 mvcc.cc:205] Tried to move back new op lower bound from 7317342076657291264 to 7317342076581453824. Current Snapshot: MvccSnapshot[applied={T|T < 7317342076657291264}]
I20260811 15:01:07.955956 5046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:59976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:07.956166 5046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:59976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:07.958758 5046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Sending DeleteTablet for 3 replicas of tablet 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:07.959592 5735 tablet_service.cc:1514] Processing DeleteTablet for tablet 645630a71e2f45bcabb00de262d2d146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:07 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:46378
I20260811 15:01:07.959815 5500 tablet_service.cc:1514] Processing DeleteTablet for tablet 645630a71e2f45bcabb00de262d2d146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:07 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:51874
I20260811 15:01:07.959901 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 5114
I20260811 15:01:07.968591 5930 tablet_replica.cc:330] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: stopping tablet replica
I20260811 15:01:07.969120 5930 raft_consensus.cc:2229] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:07.969518 5930 raft_consensus.cc:2258] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:07.974021 5931 tablet_replica.cc:330] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: stopping tablet replica
I20260811 15:01:07.974407 5931 raft_consensus.cc:2229] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:07.974797 5931 raft_consensus.cc:2258] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:07.974794 5930 ts_tablet_manager.cc:1905] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:07.976401 5931 ts_tablet_manager.cc:1905] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:07.978624 5930 ts_tablet_manager.cc:1918] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:07.978757 5930 log.cc:1196] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/645630a71e2f45bcabb00de262d2d146
I20260811 15:01:07.979188 5930 ts_tablet_manager.cc:1939] T 645630a71e2f45bcabb00de262d2d146 P ae089f38529d4b389ff0bf9dcfc7946d: Deleting consensus metadata
I20260811 15:01:07.979369 5931 ts_tablet_manager.cc:1918] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:07.979519 5931 log.cc:1196] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/645630a71e2f45bcabb00de262d2d146
I20260811 15:01:07.979867 5931 ts_tablet_manager.cc:1939] T 645630a71e2f45bcabb00de262d2d146 P c33ebcfd4c2d42af80c2688942edec3e: Deleting consensus metadata
I20260811 15:01:07.980751 5022 catalog_manager.cc:4841] TS ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): tablet 645630a71e2f45bcabb00de262d2d146 (table test-table [id=392f10a63d0a491bb343df994f0c5475]) successfully deleted
I20260811 15:01:07.981155 5023 catalog_manager.cc:4841] TS c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): tablet 645630a71e2f45bcabb00de262d2d146 (table test-table [id=392f10a63d0a491bb343df994f0c5475]) successfully deleted
W20260811 15:01:07.982045 5017 connection.cc:535] client connection to 127.11.225.65:38929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 15:01:07.982226 5017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:01:07.982398 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 5386
I20260811 15:01:07.988890 5881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:07.988462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:38929 (local address 127.0.0.1:41238)
0811 15:01:07.988671 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:07.988771 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:38929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 15:01:07.989902 5017 catalog_manager.cc:4584] TS 23bc6a435c03468296d68b5e753fd7a8 (127.11.225.65:38929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 645630a71e2f45bcabb00de262d2d146: Network error: Client connection negotiation failed: client connection to 127.11.225.65:38929: connect: Connection refused (error 111)
I20260811 15:01:07.996976 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 5621
I20260811 15:01:08.011334 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 4987
I20260811 15:01:08.029318 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--webserver_interface=127.11.225.126
--webserver_port=45919
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:08.145519 5935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:08.145778 5935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:08.145848 5935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:08.149847 5935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:08.149901 5935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:08.149921 5935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:08.149937 5935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:08.149991 5935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:08.155189 5935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=45919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:08.156330 5935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:08.157444 5935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:08.166077 5944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.166106 5945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.166384 5948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:08.166934 5935 server_base.cc:1034] running on GCE node
I20260811 15:01:08.167542 5935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:08.168620 5935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:08.169778 5935 hybrid_clock.cc:648] HybridClock initialized: now 1786460468169747 us; error 44 us; skew 500 ppm
Aug 11 15:01:08 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:08.172696 5935 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:08.173689 5935 webserver.cc:460] Webserver started at http://127.11.225.126:45919/ using document root <none> and password file <none>
I20260811 15:01:08.174239 5935 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:08.174302 5935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:08.178333 5935 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:08.180637 5956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.181986 5935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:08.182117 5935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "9405661f3ded478db72ba27380388a68"
format_stamp: "Formatted at 2026-08-11 15:01:05 on dist-test-slave-8hhm"
server_key: "1d1348080dd9a4f29430be151cc19398"
server_key_iv: "d4c704d91e5eea1582d75ddb3f63e986"
server_key_version: "encryptionkey@0"
I20260811 15:01:08.182664 5935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:08.221920 5935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:08.225371 5935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:08.225566 5935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:08.232914 5935 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41529
I20260811 15:01:08.233227 6060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41529 every 8 connection(s)
I20260811 15:01:08.234135 5935 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:08.236760 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 5935
I20260811 15:01:08.237275 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:38929
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=38303
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:08.238569 6062 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:01:08.240221 6062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap starting.
I20260811 15:01:08.258263 6062 log.cc:824] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:08.269748 6062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:08.270169 6062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68: Bootstrap complete.
I20260811 15:01:08.274412 6062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:08.274820 6062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9405661f3ded478db72ba27380388a68, State: Initialized, Role: FOLLOWER
I20260811 15:01:08.275312 6062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:08.275465 6062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:08.275547 6062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:08.275672 6062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 2 FOLLOWER]: Advancing to term 3
I20260811 15:01:08.277827 6062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:08.278209 6062 leader_election.cc:302] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9405661f3ded478db72ba27380388a68; no voters:
I20260811 15:01:08.278574 6062 leader_election.cc:288] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 15:01:08.278712 6068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 15:01:08.278973 6068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [term 3 LEADER]: Becoming Leader. State: Replica: 9405661f3ded478db72ba27380388a68, State: Running, Role: LEADER
I20260811 15:01:08.279295 6068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } }
I20260811 15:01:08.279822 6062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:08.280962 6073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:08.281092 6073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:08.280968 6074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9405661f3ded478db72ba27380388a68. Latest consensus state: current_term: 3 leader_uuid: "9405661f3ded478db72ba27380388a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9405661f3ded478db72ba27380388a68" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41529 } } }
I20260811 15:01:08.281478 6074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9405661f3ded478db72ba27380388a68 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:08.282296 6083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:08.287355 6083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:08.288023 6083 catalog_manager.cc:1259] Loaded cluster ID: c4339c19e69142118c0e9577440aa2e5
I20260811 15:01:08.288095 6083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 15:01:08.289225 6083 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2bc40329ad google::LogMessage::Fail() at ??:0
@ 0x7f2bc403588a google::LogMessage::SendToLog() at ??:0
@ 0x7f2bc40324de google::LogMessage::Flush() at ??:0
@ 0x7f2bc4033a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2bce971fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f2bce972d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2bce96f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f2bce9b3640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2bc62843d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2bc6284c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2bc62863f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2bc6275512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2bc78b96db start_thread at ??:0
@ 0x7f2bc2b3061f clone at ??:0
W20260811 15:01:08.368259 6065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:08.368511 6065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:08.368553 6065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:08.372680 6065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:08.372766 6065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:08.372864 6065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:01:08.378278 6065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:38929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=38303
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:08.379352 6065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:08.380402 6065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:08.390030 6138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.390056 6139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.390031 6145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:08.390542 6065 server_base.cc:1034] running on GCE node
I20260811 15:01:08.390996 6065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:08.391758 6065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:08.392968 6065 hybrid_clock.cc:648] HybridClock initialized: now 1786460468392914 us; error 63 us; skew 500 ppm
Aug 11 15:01:08 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:08.396425 6065 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:01:08.397586 6065 webserver.cc:460] Webserver started at http://127.11.225.65:38303/ using document root <none> and password file <none>
I20260811 15:01:08.398322 6065 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:08.398423 6065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:08.403553 6065 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:01:08.406221 6154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.407907 6065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:01:08.408034 6065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "23bc6a435c03468296d68b5e753fd7a8"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "ef8818a0ea4dfbdb5e3d2c638eb755fe"
server_key_iv: "38aa6dcffb4d848bae1a1c43405fa896"
server_key_version: "encryptionkey@0"
I20260811 15:01:08.408795 6065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:08.439078 6065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:08.443228 6065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:08.443439 6065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:08.444213 6065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:08.445783 6170 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:01:08.450342 6065 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:01:08.450424 6065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 15:01:08.450497 6065 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:01:08.452777 6065 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:01:08.452839 6065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:01:08.453330 6170 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap starting.
I20260811 15:01:08.463943 6065 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:38929
I20260811 15:01:08.464103 6372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:38929 every 8 connection(s)
I20260811 15:01:08.465514 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 6065
I20260811 15:01:08.465206 6065 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:01:08.466019 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:36129
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=33981
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:08.474434 6170 log.cc:824] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:08.484812 6170 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:08.485234 6170 tablet_bootstrap.cc:492] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Bootstrap complete.
I20260811 15:01:08.486680 6170 ts_tablet_manager.cc:1397] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Time spent bootstrapping tablet: real 0.034s user 0.017s sys 0.015s
I20260811 15:01:08.489766 6170 raft_consensus.cc:348] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:08.490300 6170 raft_consensus.cc:729] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23bc6a435c03468296d68b5e753fd7a8, State: Initialized, Role: FOLLOWER
I20260811 15:01:08.490813 6170 consensus_queue.cc:260] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:08.491932 6170 ts_tablet_manager.cc:1428] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
W20260811 15:01:08.528326 6379 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:01:08.468401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:45967)
0811 15:01:08.469704 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.469765 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:08.470848 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:08.527527 (+ 56679us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1048,"thread_start_us":182,"threads_started":1}
W20260811 15:01:08.528975 6373 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:41529 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:41529: Client connection negotiation failed: client connection to 127.11.225.126:41529: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:01:08.529773 6379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.529473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:46323)
0811 15:01:08.529620 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.529714 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 15:01:08.530534 6379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.530304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:45909)
0811 15:01:08.530419 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.530469 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 15:01:08.530742 6373 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:01:08.593606 6377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:08.593881 6377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:08.593948 6377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:08.598009 6377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:08.598078 6377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:08.598158 6377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:01:08.603564 6377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:36129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=33981
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:08.604665 6377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:08.605760 6377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:08.615700 6403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.615743 6400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.615687 6401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:08.615983 6377 server_base.cc:1034] running on GCE node
I20260811 15:01:08.616355 6377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:08.617283 6377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:08.618505 6377 hybrid_clock.cc:648] HybridClock initialized: now 1786460468618461 us; error 65 us; skew 500 ppm
Aug 11 15:01:08 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:08.621481 6377 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:01:08.622438 6377 webserver.cc:460] Webserver started at http://127.11.225.66:33981/ using document root <none> and password file <none>
I20260811 15:01:08.623035 6377 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:08.623134 6377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:08.627104 6377 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:08.629288 6415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.630523 6377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:08.630662 6377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c33ebcfd4c2d42af80c2688942edec3e"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "618d8f70816efab6e6fc0f25fc282ee9"
server_key_iv: "01ee95c31ad90533b0d1bfd07a1e76b5"
server_key_version: "encryptionkey@0"
I20260811 15:01:08.631206 6377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:08.652618 6377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:08.655862 6377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:08.656059 6377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:08.656713 6377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:08.657667 6377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:08.657742 6377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.657809 6377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:08.657837 6377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.667403 6377 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:36129
I20260811 15:01:08.667425 6623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:36129 every 8 connection(s)
I20260811 15:01:08.668439 6377 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:01:08.671365 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 6377
I20260811 15:01:08.671866 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:37099
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:41529
--webserver_port=46815
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:08.673072 6626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.670633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:42663)
0811 15:01:08.671173 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.671336 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":116,"threads_started":1}
W20260811 15:01:08.673547 6624 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:41529 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:41529: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
I20260811 15:01:08.674183 6626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.673954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:42063)
0811 15:01:08.674074 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.674130 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 15:01:08.674886 6626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.674606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:38521)
0811 15:01:08.674741 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.674806 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:01:08.675109 6624 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:01:08.789484 6627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:08.789783 6627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:08.789867 6627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:08.793923 6627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:08.794006 6627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:08.794098 6627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:01:08.799455 6627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:37099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=46815
--tserver_master_addrs=127.11.225.126:41529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:08.800562 6627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:08.801658 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:08.812709 6635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:08.812773 6627 server_base.cc:1034] running on GCE node
W20260811 15:01:08.812728 6639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:08.812732 6634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:08.813465 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:08.814035 6627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:08.815200 6627 hybrid_clock.cc:648] HybridClock initialized: now 1786460468815206 us; error 66 us; skew 500 ppm
Aug 11 15:01:08 dist-test-slave-8hhm krb5kdc[4013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:08.818125 6627 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:01:08.819006 6627 webserver.cc:460] Webserver started at http://127.11.225.67:46815/ using document root <none> and password file <none>
I20260811 15:01:08.819559 6627 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:08.819689 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:08.823534 6627 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 15:01:08.825716 6652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.826994 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:08.827152 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "ae089f38529d4b389ff0bf9dcfc7946d"
format_stamp: "Formatted at 2026-08-11 15:01:06 on dist-test-slave-8hhm"
server_key: "b46dcde57c21741b9d4970c1a37687aa"
server_key_iv: "8c00ebb57b7c0a4fa8cce0ce66e3ab05"
server_key_version: "encryptionkey@0"
I20260811 15:01:08.827718 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:08.844751 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:08.848269 6627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:08.848484 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:08.849116 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:08.850133 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:08.850207 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.850281 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:08.850332 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:08.859961 6627 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37099
I20260811 15:01:08.859987 6853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37099 every 8 connection(s)
I20260811 15:01:08.860983 6627 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:01:08.864962 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.863196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:50853)
0811 15:01:08.863651 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.863765 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
W20260811 15:01:08.865454 6855 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:41529 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:41529: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
I20260811 15:01:08.866044 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.865843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:41563)
0811 15:01:08.865943 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.865989 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 15:01:08.866734 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:08.866497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:58911)
0811 15:01:08.866619 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:08.866659 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 15:01:08.866962 6855 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:01:08.873179 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 6627
I20260811 15:01:09.531913 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:09.531406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:56495)
0811 15:01:09.531717 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:09.531795 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":92,"threads_started":1}
I20260811 15:01:09.676146 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:09.675703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:53655)
0811 15:01:09.675995 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:09.676048 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260811 15:01:09.867964 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:09.867537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:55083)
0811 15:01:09.867808 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:09.867865 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":72,"threads_started":1}
I20260811 15:01:10.121693 6866 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:10.121928 6866 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:10.123162 6866 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
Aug 11 15:01:10 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.66@KRBTEST.COM
Aug 11 15:01:10 dist-test-slave-8hhm krb5kdc[4013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.67@KRBTEST.COM
I20260811 15:01:10.137575 6867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.123410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:36129 (local address 127.11.225.65:60067)
0811 15:01:10.124082 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:10.124096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:10.124167 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:10.125477 (+ 1310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:10.125484 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:10.126050 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:10.126486 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:10.126501 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.127841 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.127845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:10.128729 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:10.128739 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.129521 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.129525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:10.129772 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:10.130497 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:10.130516 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:10.132381 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:10.135033 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:10.135038 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:10.135049 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:10.135387 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:10.135761 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:10.135765 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:10.135767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:10.135914 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:10.136574 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:10.136581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:10.136822 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 15:01:10.137015 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 15:01:10.137368 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":101,"spinlock_wait_cycles":18048,"thread_start_us":88,"threads_started":1}
I20260811 15:01:10.137607 6871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.123751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:60067 (local address 127.11.225.66:36129)
0811 15:01:10.124097 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:10.124118 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:10.124153 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:01:10.124845 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:10.124851 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:10.125156 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:10.125480 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:10.126681 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.127684 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.128860 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.129379 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.129552 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:10.132608 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:10.132613 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:10.132624 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:10.132652 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:10.134919 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:10.135513 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:10.135519 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:10.135524 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:10.135647 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:10.136011 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:10.136014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:10.136016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:10.136421 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:10.136614 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:10.137123 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 15:01:10.137435 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":89,"threads_started":1}
I20260811 15:01:10.137635 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.123494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51279 (local address 127.11.225.67:37099)
0811 15:01:10.123777 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:10.123809 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:10.123858 (+ 49us) server_negotiation.cc:407] Connection header received
0811 15:01:10.124728 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:10.124734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:10.125083 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:10.125432 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:10.126654 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.127679 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.128850 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.129388 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.129569 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:10.132851 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:10.132860 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:10.132876 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:10.132914 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:10.134919 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:10.135771 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:10.135777 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:10.135782 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:10.135900 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:10.136197 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:10.136201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:10.136202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:10.136561 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:10.136713 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:10.137123 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 15:01:10.137438 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":62,"threads_started":1}
I20260811 15:01:10.137616 6869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.123336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37099 (local address 127.11.225.65:51279)
0811 15:01:10.123709 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:10.123723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:10.123846 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:10.125476 (+ 1630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:10.125482 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:10.126045 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:10.126485 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:10.126501 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.127856 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.127859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:10.128724 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:10.128735 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:10.129518 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:10.129522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:10.129771 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:10.130439 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:10.130456 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:10.132654 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:10.135498 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:10.135500 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:10.135501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:10.135662 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:10.136009 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:10.136012 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:10.136013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:10.136096 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:10.136696 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:10.136699 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:10.136827 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 15:01:10.137006 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 15:01:10.137455 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":251,"spinlock_wait_cycles":17664,"thread_start_us":87,"threads_started":1}
W20260811 15:01:10.141196 6161 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
W20260811 15:01:10.141386 6160 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:10.141482 6160 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8; no voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e
I20260811 15:01:10.141772 6866 raft_consensus.cc:2726] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:01:10.533094 6869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.532759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:44227)
0811 15:01:10.532915 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:10.532998 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 15:01:10.677342 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.676862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:36593)
0811 15:01:10.677105 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:10.677161 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260811 15:01:10.869205 6876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:10.868771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:32925)
0811 15:01:10.869052 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:10.869111 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":74,"threads_started":1}
I20260811 15:01:11.534348 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:11.533859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:59215)
0811 15:01:11.534130 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:11.534189 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":78,"threads_started":1}
I20260811 15:01:11.678489 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:11.678075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:52089)
0811 15:01:11.678347 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:11.678400 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
I20260811 15:01:11.870503 6882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:11.870071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:45907)
0811 15:01:11.870346 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:11.870405 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":84,"threads_started":1}
I20260811 15:01:12.275938 6884 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:12.276080 6884 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:12.276612 6884 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
W20260811 15:01:12.277518 6160 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
W20260811 15:01:12.277827 6161 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:12.277930 6161 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8; no voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e
I20260811 15:01:12.278162 6884 raft_consensus.cc:2726] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:01:12.535742 6885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:12.535234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:42193)
0811 15:01:12.535546 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:12.535622 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":85,"threads_started":1}
I20260811 15:01:12.679710 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:12.679267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:45457)
0811 15:01:12.679565 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:12.679620 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":94,"threads_started":1}
I20260811 15:01:12.871748 6888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:12.871267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:46827)
0811 15:01:12.871571 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:12.871635 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":93,"threads_started":1}
I20260811 15:01:13.537307 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:13.536766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:34873)
0811 15:01:13.537094 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:13.537151 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":74,"threads_started":1}
I20260811 15:01:13.680819 6891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:13.680412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:50425)
0811 15:01:13.680671 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:13.680725 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":75,"threads_started":1}
I20260811 15:01:13.820607 6893 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:13.820737 6893 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:13.821216 6893 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
W20260811 15:01:13.822083 6160 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
W20260811 15:01:13.822237 6161 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:13.822336 6161 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8; no voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e
I20260811 15:01:13.822525 6893 raft_consensus.cc:2726] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:01:13.872884 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:13.872474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:51455)
0811 15:01:13.872730 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:13.872785 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":71,"threads_started":1}
I20260811 15:01:14.538506 6896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:14.538070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:37803)
0811 15:01:14.538348 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:14.538406 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
I20260811 15:01:14.681952 6907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:14.681566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:44011)
0811 15:01:14.681806 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:14.681859 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":73,"threads_started":1}
I20260811 15:01:14.874325 6908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:14.873817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:41155)
0811 15:01:14.874152 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:14.874220 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":79,"threads_started":1}
I20260811 15:01:15.539788 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:15.539345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:57371)
0811 15:01:15.539616 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:15.539679 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":73,"threads_started":1}
I20260811 15:01:15.683213 6910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:15.682748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:41705)
0811 15:01:15.683045 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:15.683103 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":75,"threads_started":1}
I20260811 15:01:15.875686 6911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:15.875180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:48071)
0811 15:01:15.875522 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:15.875589 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":115,"threads_started":1}
I20260811 15:01:16.541067 6915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:16.540633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:57989)
0811 15:01:16.540902 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:16.540962 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
I20260811 15:01:16.684491 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:16.683967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:49487)
0811 15:01:16.684333 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:16.684393 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":96,"threads_started":1}
I20260811 15:01:16.877013 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:16.876530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:54505)
0811 15:01:16.876838 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:16.876905 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":87,"threads_started":1}
I20260811 15:01:17.542349 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:17.541884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:55917)
0811 15:01:17.542182 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:17.542246 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":79,"threads_started":1}
I20260811 15:01:17.685820 6920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:17.685384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:42071)
0811 15:01:17.685656 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:17.685724 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":77,"threads_started":1}
I20260811 15:01:17.878535 6923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:17.878062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:51761)
0811 15:01:17.878358 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:17.878422 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":98,"threads_started":1}
I20260811 15:01:18.064925 6924 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:18.065064 6924 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:18.065634 6924 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
W20260811 15:01:18.066529 6161 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
W20260811 15:01:18.066620 6160 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:18.066663 6161 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8; no voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e
I20260811 15:01:18.066792 6924 raft_consensus.cc:2726] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:01:18.543720 6925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:18.543236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:40267)
0811 15:01:18.543559 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:18.543619 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":78,"threads_started":1}
I20260811 15:01:18.687242 6926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:18.686754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:53917)
0811 15:01:18.687075 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:18.687140 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260811 15:01:18.879926 6928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:18.879434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:42021)
0811 15:01:18.879728 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:18.879794 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":83,"threads_started":1}
I20260811 15:01:19.545032 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:19.544572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:32809)
0811 15:01:19.544867 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:19.544924 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":109,"threads_started":1}
I20260811 15:01:19.688581 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:19.688110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:48443)
0811 15:01:19.688409 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:19.688473 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":78,"threads_started":1}
I20260811 15:01:19.881507 6936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:19.880909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:58745)
0811 15:01:19.881335 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:19.881402 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":136,"threads_started":1}
I20260811 15:01:20.546275 6937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:20.545816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:57461)
0811 15:01:20.546114 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:20.546172 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":77,"threads_started":1}
I20260811 15:01:20.689896 6938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:20.689498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:39073)
0811 15:01:20.689741 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:20.689797 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":84,"threads_started":1}
I20260811 15:01:20.883129 6940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:20.882456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:51513)
0811 15:01:20.882811 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:20.882914 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":96,"threads_started":1}
I20260811 15:01:21.464864 6941 raft_consensus.cc:482] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:21.465003 6941 raft_consensus.cc:504] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae089f38529d4b389ff0bf9dcfc7946d" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37099 } } peers { permanent_uuid: "c33ebcfd4c2d42af80c2688942edec3e" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 36129 } } peers { permanent_uuid: "23bc6a435c03468296d68b5e753fd7a8" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 38929 } }
I20260811 15:01:21.465557 6941 leader_election.cc:288] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099), c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129)
W20260811 15:01:21.466323 6160 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ae089f38529d4b389ff0bf9dcfc7946d (127.11.225.67:37099): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
W20260811 15:01:21.466444 6161 leader_election.cc:341] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c33ebcfd4c2d42af80c2688942edec3e (127.11.225.66:36129): Not found: Tablet not found: 645630a71e2f45bcabb00de262d2d146
I20260811 15:01:21.466557 6161 leader_election.cc:302] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23bc6a435c03468296d68b5e753fd7a8; no voters: ae089f38529d4b389ff0bf9dcfc7946d, c33ebcfd4c2d42af80c2688942edec3e
I20260811 15:01:21.466759 6941 raft_consensus.cc:2726] T 645630a71e2f45bcabb00de262d2d146 P 23bc6a435c03468296d68b5e753fd7a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:01:21.547646 6945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:21.547171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:34687)
0811 15:01:21.547485 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:21.547542 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":108,"threads_started":1}
I20260811 15:01:21.691210 6948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:21.690785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:44717)
0811 15:01:21.691052 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:21.691110 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":90,"threads_started":1}
I20260811 15:01:21.884478 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:21.884031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:41903)
0811 15:01:21.884319 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:21.884379 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":100,"threads_started":1}
I20260811 15:01:22.549105 6950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:22.548633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:37231)
0811 15:01:22.548934 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:22.549003 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":108,"threads_started":1}
I20260811 15:01:22.692325 6951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:22.691910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:60255)
0811 15:01:22.692174 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:22.692229 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
I20260811 15:01:22.885952 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:22.885454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:37617)
0811 15:01:22.885758 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:22.885827 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":109,"threads_started":1}
I20260811 15:01:23.550724 6953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:23.550232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.65:39953)
0811 15:01:23.550549 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:23.550616 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":81,"threads_started":1}
I20260811 15:01:23.695663 6956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:23.693312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.66:59047)
0811 15:01:23.695462 (+ 2150us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:23.695556 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2060,"thread_start_us":1924,"threads_started":1}
I20260811 15:01:23.880721 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 6065
I20260811 15:01:23.889317 6957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:23.887180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:41529 (local address 127.11.225.67:55027)
0811 15:01:23.889092 (+ 1912us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:23.889162 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:41529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1826,"thread_start_us":1709,"threads_started":1}
I20260811 15:01:23.895826 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 6377
I20260811 15:01:23.909118 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 6627
2026-08-11T15:01:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19701 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:01:23 dist-test-slave-8hhm krb5kdc[6961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:01:23 dist-test-slave-8hhm krb5kdc[6961](info): set up 2 sockets
Aug 11 15:01:23 dist-test-slave-8hhm krb5kdc[6961](info): commencing operation
krb5kdc: starting...
W20260811 15:01:25.246173 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:01:25 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:01:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:01:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:01:25.379819 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:32859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:25.495888 6989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:25.496165 6989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:25.496203 6989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:25.500118 6989 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:01:25.500167 6989 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:01:25.500183 6989 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:01:25.500196 6989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:25.500213 6989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:25.500231 6989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:25.500247 6989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:25.500262 6989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:25.505378 6989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:32859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:25.506417 6989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:25.507433 6989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:25.516567 6995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:25.516630 6989 server_base.cc:1034] running on GCE node
W20260811 15:01:25.516582 6997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:25.516706 6999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:25.517598 6989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:25.518774 6989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:25.519948 6989 hybrid_clock.cc:648] HybridClock initialized: now 1786460485519906 us; error 50 us; skew 500 ppm
Aug 11 15:01:25 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460485, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:25.522953 6989 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:25.523898 6989 webserver.cc:460] Webserver started at http://127.11.225.126:41549/ using document root <none> and password file <none>
I20260811 15:01:25.524470 6989 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:25.524544 6989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:25.524791 6989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:25.527096 6989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "09c56d6629a0428a8d525f6bf16e6f46"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "9d22566e12c6821f579c3db1244c4863"
server_key_iv: "9edc5290c261ef2cd3c7f68e8439ef8a"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.527773 6989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "09c56d6629a0428a8d525f6bf16e6f46"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "9d22566e12c6821f579c3db1244c4863"
server_key_iv: "9edc5290c261ef2cd3c7f68e8439ef8a"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.531832 6989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 15:01:25.534477 7008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:25.535751 6989 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:01:25.535904 6989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "09c56d6629a0428a8d525f6bf16e6f46"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "9d22566e12c6821f579c3db1244c4863"
server_key_iv: "9edc5290c261ef2cd3c7f68e8439ef8a"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.536029 6989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:25.562037 6989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:25.565330 6989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:25.565565 6989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:25.573418 6989 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:32859
I20260811 15:01:25.573767 7103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:32859 every 8 connection(s)
I20260811 15:01:25.574476 6989 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:25.577142 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 6989
I20260811 15:01:25.577315 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:01:25.577574 7104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:25.577615 12165 external_mini_cluster.cc:1428] Setting key b7087c4438eca8357db6179b0e666249
I20260811 15:01:25.585695 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap starting.
Aug 11 15:01:25 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:25.588318 7104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:25.589370 7104 log.cc:824] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:25.591894 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: No bootstrap required, opened a new log
I20260811 15:01:25.593806 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:25.579179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34410 (local address 127.11.225.126:32859)
0811 15:01:25.579663 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:25.579684 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:25.579732 (+ 48us) server_negotiation.cc:407] Connection header received
0811 15:01:25.580680 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:25.580706 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:25.581142 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:25.581595 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:25.582335 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.583818 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.584707 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.585451 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.585630 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:25.588259 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:25.588269 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:25.588289 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:25.588326 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:25.590427 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:25.590912 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:25.590918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:25.590924 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:25.591084 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:25.591371 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:25.591375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:25.591377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:25.591938 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:25.592151 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:25.592476 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 15:01:25.592790 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":127,"threads_started":1}
I20260811 15:01:25.596575 7104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:25.596808 7104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:25.596858 7104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Initialized, Role: FOLLOWER
I20260811 15:01:25.597355 7104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:25.597496 7104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:25.597549 7104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:25.597630 7104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:25.598533 7104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:25.598834 7104 leader_election.cc:302] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09c56d6629a0428a8d525f6bf16e6f46; no voters:
I20260811 15:01:25.599210 7104 leader_election.cc:288] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:01:25.599284 7115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:25.599608 7115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 LEADER]: Becoming Leader. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Running, Role: LEADER
I20260811 15:01:25.599943 7115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:25.600505 7104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:25.601761 7120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09c56d6629a0428a8d525f6bf16e6f46. Latest consensus state: current_term: 1 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:01:25.601938 7120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:25.602267 7119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:01:25.602386 7133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:25.605348 7119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:25.606307 7133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:25.612506 7133 catalog_manager.cc:1347] Generated new cluster ID: 6e7864b92fee4491b73bab711739f81f
I20260811 15:01:25.612581 7133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:25.621765 7133 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:01:25.622646 7133 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:25.627760 7133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Generated new TSK 0
I20260811 15:01:25.628470 7133 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:01:25.668037 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:25.804672 7148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:25.804956 7148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:25.805001 7148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:25.808962 7148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:25.809020 7148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:25.809078 7148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:01:25.814105 7148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:25.815057 7148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:25.816105 7148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:25.825868 7171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:25.825819 7165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:25.825964 7148 server_base.cc:1034] running on GCE node
W20260811 15:01:25.826023 7168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:25.826566 7148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:25.827165 7148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:25.828346 7148 hybrid_clock.cc:648] HybridClock initialized: now 1786460485828316 us; error 39 us; skew 500 ppm
Aug 11 15:01:25 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460485, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:25.831593 7148 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:01:25.832502 7148 webserver.cc:460] Webserver started at http://127.11.225.65:43347/ using document root <none> and password file <none>
I20260811 15:01:25.833038 7148 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:25.833105 7148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:25.833369 7148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:25.835407 7148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "4b2839d49fce43509f00c2754be3ad48"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "17b4d3ace68dbdb71a92661114ba328b"
server_key_iv: "ef462df5342ee9621c9e38d19d18dddd"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.836004 7148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "4b2839d49fce43509f00c2754be3ad48"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "17b4d3ace68dbdb71a92661114ba328b"
server_key_iv: "ef462df5342ee9621c9e38d19d18dddd"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.840023 7148 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:01:25.842643 7185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:25.844218 7148 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:01:25.844350 7148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "4b2839d49fce43509f00c2754be3ad48"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "17b4d3ace68dbdb71a92661114ba328b"
server_key_iv: "ef462df5342ee9621c9e38d19d18dddd"
server_key_version: "encryptionkey@0"
I20260811 15:01:25.844466 7148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:25.889489 7148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:25.893097 7148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:25.893334 7148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:25.893992 7148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:25.894883 7148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:25.894964 7148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:25.895071 7148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:25.895112 7148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:25.904706 7148 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:35533
I20260811 15:01:25.904750 7372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:35533 every 8 connection(s)
I20260811 15:01:25.905733 7148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:01:25.907335 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 7148
I20260811 15:01:25.907459 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:01:25.907811 12165 external_mini_cluster.cc:1428] Setting key 3d9ef986cca7979d30b84c3b3e9018a1
Aug 11 15:01:25 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460485, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 15:01:25.921612 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:25.907803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51691 (local address 127.11.225.126:32859)
0811 15:01:25.907955 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:25.907962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:25.908973 (+ 1011us) server_negotiation.cc:407] Connection header received
0811 15:01:25.910396 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:25.910401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:25.910463 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:25.910557 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:25.911777 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.912646 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.914457 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.914712 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.914802 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:25.917774 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:25.917780 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:25.917784 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:25.917827 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:25.919466 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:25.920048 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:25.920054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:25.920059 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:25.920158 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:25.920475 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:25.920477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:25.920478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:25.920658 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:25.920732 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:25.921371 (+ 639us) server_negotiation.cc:299] Negotiation successful
0811 15:01:25.921477 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:01:25.922540 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:25.908303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:51691)
0811 15:01:25.908800 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:25.908854 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:25.910184 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:25.910715 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:25.910722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:25.911131 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:25.911614 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:25.911627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.912797 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.912800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:25.914316 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:25.914331 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:25.914895 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:25.914903 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:25.915145 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:25.915816 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:25.915842 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:25.917600 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:25.919598 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:25.919603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:25.919615 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:25.919925 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:25.920245 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:25.920247 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:25.920248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:25.920383 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:25.920812 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:25.920817 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:25.921067 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 15:01:25.921322 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 15:01:25.921588 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":168,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 15:01:25.923959 7378 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:25.924237 7378 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:25.924844 7378 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
I20260811 15:01:25.926751 7042 ts_manager.cc:194] Registered new tserver with Master: 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533)
I20260811 15:01:25.927888 7042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:51691
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:01:25.942047 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:26.056723 7386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:26.057065 7386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:26.057158 7386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:26.061153 7386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:26.061285 7386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:26.061384 7386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:01:26.066753 7386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:26.067984 7386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:26.069046 7386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:26.079023 7394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:26.079030 7400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:26.079084 7386 server_base.cc:1034] running on GCE node
W20260811 15:01:26.079030 7407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:26.079638 7386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:26.080278 7386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:26.081435 7386 hybrid_clock.cc:648] HybridClock initialized: now 1786460486081417 us; error 28 us; skew 500 ppm
Aug 11 15:01:26 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:26.084242 7386 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:01:26.085090 7386 webserver.cc:460] Webserver started at http://127.11.225.66:45155/ using document root <none> and password file <none>
I20260811 15:01:26.085732 7386 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:26.085796 7386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:26.086048 7386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:26.088090 7386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "c371e6d60baa44bf922eada3c1caa3cc"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "b8b4307667eba34dc6bcb82f3de96a5d"
server_key_iv: "82a95d31de25eb365a4bd1c38e22da3c"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.088825 7386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "c371e6d60baa44bf922eada3c1caa3cc"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "b8b4307667eba34dc6bcb82f3de96a5d"
server_key_iv: "82a95d31de25eb365a4bd1c38e22da3c"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.092764 7386 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:01:26.095592 7418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.096904 7386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:01:26.097054 7386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c371e6d60baa44bf922eada3c1caa3cc"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "b8b4307667eba34dc6bcb82f3de96a5d"
server_key_iv: "82a95d31de25eb365a4bd1c38e22da3c"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.097188 7386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:26.110042 7386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:26.112805 7386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:26.113023 7386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:26.113722 7386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:26.114578 7386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:26.114650 7386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.114719 7386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:26.114773 7386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.123615 7386 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35203
I20260811 15:01:26.123659 7637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35203 every 8 connection(s)
I20260811 15:01:26.124507 7386 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:01:26.129317 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 7386
I20260811 15:01:26.129443 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:01:26.129742 12165 external_mini_cluster.cc:1428] Setting key 929e1a5c4dc18967ec96920517c34077
Aug 11 15:01:26 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:26.139633 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.126426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52317 (local address 127.11.225.126:32859)
0811 15:01:26.126564 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.126568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.127488 (+ 920us) server_negotiation.cc:407] Connection header received
0811 15:01:26.128913 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.128916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.128994 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.129111 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:26.130596 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.131312 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.132467 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.132870 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.133002 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.135881 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:26.135884 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:26.135886 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:26.135910 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:26.137511 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.138072 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.138076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.138080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.138162 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.138513 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.138517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.138519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.138701 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:26.138843 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.139327 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.139450 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:01:26.140511 7645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.126821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:52317)
0811 15:01:26.127347 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.127390 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.128693 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.129311 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.129318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.129772 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:26.130403 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.130421 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.131443 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.131446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.132335 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.132352 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.133015 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.133018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.133187 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.133911 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:26.133935 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:26.135704 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:26.137638 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:26.137643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:26.137658 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:26.137943 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:26.138257 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:26.138261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:26.138263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:26.138417 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:26.138843 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:26.138851 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:26.139094 (+ 243us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.139282 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.139599 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 15:01:26.141798 7643 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:26.142019 7643 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:26.142472 7643 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 15:01:26.143707 7042 ts_manager.cc:194] Registered new tserver with Master: c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
I20260811 15:01:26.144586 7042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:52317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:01:26.159766 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:26.276654 7649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:26.276926 7649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:26.277004 7649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:26.281306 7649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:26.281370 7649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:26.281432 7649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:01:26.286849 7649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:26.287979 7649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:26.288991 7649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:26.299871 7663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:26.299831 7662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:26.299878 7669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:26.300220 7649 server_base.cc:1034] running on GCE node
I20260811 15:01:26.300724 7649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:26.301575 7649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:26.302765 7649 hybrid_clock.cc:648] HybridClock initialized: now 1786460486302753 us; error 38 us; skew 500 ppm
Aug 11 15:01:26 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:26.305876 7649 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:01:26.306902 7649 webserver.cc:460] Webserver started at http://127.11.225.67:34515/ using document root <none> and password file <none>
I20260811 15:01:26.307548 7649 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:26.307647 7649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:26.307905 7649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:01:26.310155 7649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "bea41e57c8484692937ebec4e93370d1"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "0ca5b7d1a6cbcf87f00d2fbdf8f69a41"
server_key_iv: "0c92876cdafc02817c43105dd6c3bfa8"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.310772 7649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "bea41e57c8484692937ebec4e93370d1"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "0ca5b7d1a6cbcf87f00d2fbdf8f69a41"
server_key_iv: "0c92876cdafc02817c43105dd6c3bfa8"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.314805 7649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:01:26.317548 7677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.318882 7649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:01:26.319046 7649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "bea41e57c8484692937ebec4e93370d1"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "0ca5b7d1a6cbcf87f00d2fbdf8f69a41"
server_key_iv: "0c92876cdafc02817c43105dd6c3bfa8"
server_key_version: "encryptionkey@0"
I20260811 15:01:26.319171 7649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:26.334800 7649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:26.338301 7649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:26.338512 7649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:26.339177 7649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:26.340091 7649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:26.340161 7649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.340234 7649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:26.340284 7649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:26.349949 7649 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:33519
I20260811 15:01:26.349990 7869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:33519 every 8 connection(s)
I20260811 15:01:26.350883 7649 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:01:26.357877 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 7649
I20260811 15:01:26.358008 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:01:26.358376 12165 external_mini_cluster.cc:1428] Setting key 268f9dfb8ce1e5adda270597d2dcb06b
Aug 11 15:01:26 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:26.365051 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.352806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:38869 (local address 127.11.225.126:32859)
0811 15:01:26.352946 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.352950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.353879 (+ 929us) server_negotiation.cc:407] Connection header received
0811 15:01:26.355214 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.355217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.355265 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.355349 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:26.356521 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.357044 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.358786 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.359108 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.359194 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.361930 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:26.361933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:26.361935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:26.361960 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:26.363193 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.363656 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.363658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.363659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.363736 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.364026 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.364028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.364029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.364219 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:26.364294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.364831 (+ 537us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.364929 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:01:26.365979 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.353187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:38869)
0811 15:01:26.353719 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.353762 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.354973 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.355528 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.355535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.355919 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:26.356391 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.356404 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.357157 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.357159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.358610 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.358622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.359264 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.359273 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.359448 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.360159 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:26.360176 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:26.361776 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:26.363298 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:26.363303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:26.363315 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:26.363562 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:26.363810 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:26.363812 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:26.363813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:26.363943 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:26.364340 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:26.364346 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:26.364607 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.364773 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.365094 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":105,"threads_started":1}
I20260811 15:01:26.367144 7870 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:26.367400 7870 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:26.367944 7870 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
I20260811 15:01:26.369038 7042 ts_manager.cc:194] Registered new tserver with Master: bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519)
I20260811 15:01:26.369681 7042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:38869
I20260811 15:01:26.372628 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:01:26.382602 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.374951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.11.225.126:32859)
0811 15:01:26.375068 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.375072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.375365 (+ 293us) server_negotiation.cc:407] Connection header received
0811 15:01:26.375511 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.375513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.375551 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.375614 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:26.376418 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.376917 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.377899 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.378143 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.378223 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.379670 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:26.379672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:26.379674 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:26.379695 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:26.381072 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.381542 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.381551 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.381552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.381630 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:26.381865 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:26.381867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:26.381868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:26.382068 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:26.382200 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.382391 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.382486 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:01:26.385632 7042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:01:26.388497 7042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:01:26.403781 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.397390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:33519 (local address 127.0.0.1:58058)
0811 15:01:26.398350 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.398363 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.398465 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.399150 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.399156 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.399178 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:26.399411 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.399419 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.400884 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.400887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.402159 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.402170 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.403217 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.403221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.403328 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.403370 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.403486 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.403630 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":886,"mutex_wait_us":40,"thread_start_us":108,"threads_started":1}
I20260811 15:01:26.403792 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.397771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58058 (local address 127.11.225.67:33519)
0811 15:01:26.398598 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.398607 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.398628 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:01:26.398731 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.398737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.398973 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.399160 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:26.399569 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.400732 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.402286 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.403092 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.403195 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.403343 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.403525 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.403633 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":163,"threads_started":1}
I20260811 15:01:26.404062 7892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.397968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35533 (local address 127.0.0.1:43426)
0811 15:01:26.399444 (+ 1476us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.399459 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.399544 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.400065 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.400068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.400095 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:26.400171 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.400176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.401636 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.401640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.402706 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.402714 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.403661 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.403664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.403749 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.403771 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.403860 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.403941 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1416,"mutex_wait_us":4,"thread_start_us":83,"threads_started":1}
I20260811 15:01:26.404173 7893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.398167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.11.225.65:35533)
0811 15:01:26.398449 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.398467 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.399647 (+ 1180us) server_negotiation.cc:407] Connection header received
0811 15:01:26.399731 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.399736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.399912 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.400072 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:26.400266 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.401454 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.402871 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.403540 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.403637 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.403762 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.403893 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.404001 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":95,"threads_started":1}
I20260811 15:01:26.405436 7887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.397194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35203 (local address 127.0.0.1:60302)
0811 15:01:26.397883 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.397953 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.398082 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.399200 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.399203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.399233 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:26.399404 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.399411 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.400569 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.400574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.402057 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.402067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.404998 (+ 2931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.405002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.405088 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.405110 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.405191 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.405309 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":3,"spinlock_wait_cycles":2304,"thread_start_us":95,"threads_started":1}
I20260811 15:01:26.405511 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.397365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60302 (local address 127.11.225.66:35203)
0811 15:01:26.398752 (+ 1387us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.398766 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.398791 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:01:26.398872 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.398877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.399061 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.399224 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:26.399519 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.400399 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.402183 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.403082 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.403195 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.403342 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.405256 (+ 1914us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.405371 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1257,"thread_start_us":148,"threads_started":1}
I20260811 15:01:26.407092 7760 tablet_service.cc:1467] Processing CreateTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (DEFAULT_TABLE table=test-table [id=6a7fac080bc7471db78c314b71bf67bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:26.407244 7255 tablet_service.cc:1467] Processing CreateTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (DEFAULT_TABLE table=test-table [id=6a7fac080bc7471db78c314b71bf67bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:26.408166 7760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef93f4fbfd374ad3a86ff9eaf4a24374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:26.408313 7255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef93f4fbfd374ad3a86ff9eaf4a24374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:26.408265 7506 tablet_service.cc:1467] Processing CreateTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (DEFAULT_TABLE table=test-table [id=6a7fac080bc7471db78c314b71bf67bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:26.409158 7506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef93f4fbfd374ad3a86ff9eaf4a24374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:26.414358 7894 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Bootstrap starting.
I20260811 15:01:26.416111 7900 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Bootstrap starting.
I20260811 15:01:26.416682 7894 tablet_bootstrap.cc:654] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:26.417538 7895 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap starting.
I20260811 15:01:26.417894 7894 log.cc:824] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:26.418510 7900 tablet_bootstrap.cc:654] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:26.419414 7900 log.cc:824] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:26.419695 7895 tablet_bootstrap.cc:654] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:26.420027 7894 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: No bootstrap required, opened a new log
I20260811 15:01:26.420231 7894 ts_tablet_manager.cc:1397] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:01:26.420863 7895 log.cc:824] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:26.421542 7900 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: No bootstrap required, opened a new log
I20260811 15:01:26.421720 7900 ts_tablet_manager.cc:1397] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:01:26.422468 7895 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: No bootstrap required, opened a new log
I20260811 15:01:26.422658 7895 ts_tablet_manager.cc:1397] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:01:26.424235 7894 raft_consensus.cc:348] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.424515 7894 raft_consensus.cc:374] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:26.424588 7894 raft_consensus.cc:729] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea41e57c8484692937ebec4e93370d1, State: Initialized, Role: FOLLOWER
I20260811 15:01:26.425055 7894 consensus_queue.cc:260] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.425699 7895 raft_consensus.cc:348] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.425918 7895 raft_consensus.cc:374] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:26.425987 7895 raft_consensus.cc:729] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2839d49fce43509f00c2754be3ad48, State: Initialized, Role: FOLLOWER
I20260811 15:01:26.426110 7894 ts_tablet_manager.cc:1428] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:01:26.426302 7900 raft_consensus.cc:348] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.426505 7870 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
I20260811 15:01:26.426482 7895 consensus_queue.cc:260] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.426638 7900 raft_consensus.cc:374] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:26.426783 7900 raft_consensus.cc:729] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c371e6d60baa44bf922eada3c1caa3cc, State: Initialized, Role: FOLLOWER
I20260811 15:01:26.427170 7378 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
I20260811 15:01:26.427291 7900 consensus_queue.cc:260] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.427452 7895 ts_tablet_manager.cc:1428] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:01:26.428112 7643 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
I20260811 15:01:26.428210 7900 ts_tablet_manager.cc:1428] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:01:26.485572 7910 raft_consensus.cc:482] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:26.485811 7910 raft_consensus.cc:504] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.486944 7910 leader_election.cc:288] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533)
I20260811 15:01:26.490872 7645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.487272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35533 (local address 127.11.225.66:38865)
0811 15:01:26.487399 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.487416 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.487509 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.487812 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.487815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.487834 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:26.487975 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.487982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.488852 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.488855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.489759 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.489769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.490410 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.490413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.490524 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.490549 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.490657 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.490711 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":30}
I20260811 15:01:26.490893 7893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.487379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:38865 (local address 127.11.225.65:35533)
0811 15:01:26.487491 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.487495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.487509 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:01:26.487651 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.487654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.487707 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.487782 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:26.488093 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.488725 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.489881 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.490297 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.490392 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.490433 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.490680 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.490766 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:01:26.490996 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.487351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:52563 (local address 127.11.225.67:33519)
0811 15:01:26.487469 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.487473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.487909 (+ 436us) server_negotiation.cc:407] Connection header received
0811 15:01:26.487991 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.487993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.488046 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.488130 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:26.488387 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.488895 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.489994 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.490431 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.490542 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.490589 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.490808 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.490876 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 15:01:26.491026 7911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.487275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:33519 (local address 127.11.225.66:52563)
0811 15:01:26.487808 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.487821 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:26.487913 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:26.488164 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:26.488167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:26.488185 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:26.488285 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.488290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.489004 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.489006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.489870 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:26.489880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.490560 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.490563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:26.490670 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.490695 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:01:26.490768 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:01:26.490832 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":139,"thread_start_us":139,"threads_started":1}
I20260811 15:01:26.491775 7793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef93f4fbfd374ad3a86ff9eaf4a24374" candidate_uuid: "c371e6d60baa44bf922eada3c1caa3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea41e57c8484692937ebec4e93370d1" is_pre_election: true
I20260811 15:01:26.491776 7296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef93f4fbfd374ad3a86ff9eaf4a24374" candidate_uuid: "c371e6d60baa44bf922eada3c1caa3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2839d49fce43509f00c2754be3ad48" is_pre_election: true
I20260811 15:01:26.492112 7296 raft_consensus.cc:2454] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c371e6d60baa44bf922eada3c1caa3cc in term 0.
I20260811 15:01:26.492112 7793 raft_consensus.cc:2454] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c371e6d60baa44bf922eada3c1caa3cc in term 0.
I20260811 15:01:26.492653 7425 leader_election.cc:302] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48, bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc; no voters:
I20260811 15:01:26.492941 7910 raft_consensus.cc:2781] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:01:26.493044 7910 raft_consensus.cc:482] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:01:26.493108 7910 raft_consensus.cc:3037] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:26.494203 7910 raft_consensus.cc:504] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.494588 7910 leader_election.cc:288] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [CANDIDATE]: Term 1 election: Requested vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533)
I20260811 15:01:26.494882 7793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef93f4fbfd374ad3a86ff9eaf4a24374" candidate_uuid: "c371e6d60baa44bf922eada3c1caa3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea41e57c8484692937ebec4e93370d1"
I20260811 15:01:26.494948 7296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef93f4fbfd374ad3a86ff9eaf4a24374" candidate_uuid: "c371e6d60baa44bf922eada3c1caa3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b2839d49fce43509f00c2754be3ad48"
I20260811 15:01:26.495020 7793 raft_consensus.cc:3037] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:26.495107 7296 raft_consensus.cc:3037] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:26.496274 7296 raft_consensus.cc:2454] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c371e6d60baa44bf922eada3c1caa3cc in term 1.
I20260811 15:01:26.496351 7793 raft_consensus.cc:2454] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c371e6d60baa44bf922eada3c1caa3cc in term 1.
I20260811 15:01:26.496613 7424 leader_election.cc:302] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48, c371e6d60baa44bf922eada3c1caa3cc; no voters:
I20260811 15:01:26.496802 7910 raft_consensus.cc:2781] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:26.496994 7910 raft_consensus.cc:686] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 1 LEADER]: Becoming Leader. State: Replica: c371e6d60baa44bf922eada3c1caa3cc, State: Running, Role: LEADER
I20260811 15:01:26.497387 7910 consensus_queue.cc:237] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:26.500593 7042 catalog_manager.cc:5495] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66). New cstate: current_term: 1 leader_uuid: "c371e6d60baa44bf922eada3c1caa3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } health_report { overall_health: UNKNOWN } } }
I20260811 15:01:26.524307 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.520525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60312 (local address 127.11.225.66:35203)
0811 15:01:26.520751 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:26.520754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:26.520767 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:01:26.520840 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:26.520842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:26.520898 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:26.521020 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:26.521301 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.521833 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.522784 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:26.523019 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:26.523107 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:26.523438 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:26.523895 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:01:26.524026 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:26.524059 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 15:01:26.524110 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260811 15:01:26.530367 7296 raft_consensus.cc:1261] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Refusing update from remote peer c371e6d60baa44bf922eada3c1caa3cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:26.530367 7793 raft_consensus.cc:1261] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Refusing update from remote peer c371e6d60baa44bf922eada3c1caa3cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:26.531126 7910 consensus_queue.cc:1035] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:26.531370 7912 consensus_queue.cc:1035] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:26.540083 7916 mvcc.cc:205] Tried to move back new op lower bound from 7317342152820731904 to 7317342152695848960. Current Snapshot: MvccSnapshot[applied={T|T < 7317342152820731904}]
I20260811 15:01:26.541815 7918 mvcc.cc:205] Tried to move back new op lower bound from 7317342152820731904 to 7317342152695848960. Current Snapshot: MvccSnapshot[applied={T|T < 7317342152820731904}]
I20260811 15:01:26.549772 7040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:26.549968 7040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:26.552609 7040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Sending DeleteTablet for 3 replicas of tablet ef93f4fbfd374ad3a86ff9eaf4a24374
I20260811 15:01:26.553541 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 7148
I20260811 15:01:26.553452 7760 tablet_service.cc:1514] Processing DeleteTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:58058
I20260811 15:01:26.553996 7506 tablet_service.cc:1514] Processing DeleteTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:60302
I20260811 15:01:26.556708 7936 tablet_replica.cc:330] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: stopping tablet replica
I20260811 15:01:26.557051 7936 raft_consensus.cc:2229] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:01:26.557511 7936 raft_consensus.cc:2258] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:26.561926 7936 ts_tablet_manager.cc:1905] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:26.564965 7936 ts_tablet_manager.cc:1918] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:26.565073 7936 log.cc:1196] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/ef93f4fbfd374ad3a86ff9eaf4a24374
I20260811 15:01:26.565493 7936 ts_tablet_manager.cc:1939] T ef93f4fbfd374ad3a86ff9eaf4a24374 P c371e6d60baa44bf922eada3c1caa3cc: Deleting consensus metadata
I20260811 15:01:26.566953 7934 tablet_replica.cc:330] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: stopping tablet replica
I20260811 15:01:26.566905 7016 catalog_manager.cc:4841] TS c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (table test-table [id=6a7fac080bc7471db78c314b71bf67bd]) successfully deleted
I20260811 15:01:26.567340 7934 raft_consensus.cc:2229] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:26.567692 7934 raft_consensus.cc:2258] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:26.569391 7934 ts_tablet_manager.cc:1905] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 15:01:26.570955 7016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:35533 (error 108)
I20260811 15:01:26.572069 7934 ts_tablet_manager.cc:1918] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:26.572156 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 7386
I20260811 15:01:26.572206 7887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:26.571885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35533 (local address 127.0.0.1:43442)
0811 15:01:26.572030 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:26.572108 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:01:26.572257 7934 log.cc:1196] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/ef93f4fbfd374ad3a86ff9eaf4a24374
I20260811 15:01:26.575032 7934 ts_tablet_manager.cc:1939] T ef93f4fbfd374ad3a86ff9eaf4a24374 P bea41e57c8484692937ebec4e93370d1: Deleting consensus metadata
I20260811 15:01:26.576587 7018 catalog_manager.cc:4841] TS bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (table test-table [id=6a7fac080bc7471db78c314b71bf67bd]) successfully deleted
W20260811 15:01:26.579538 7016 catalog_manager.cc:4584] TS 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef93f4fbfd374ad3a86ff9eaf4a24374: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35533: connect: Connection refused (error 111)
I20260811 15:01:26.588187 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 7649
I20260811 15:01:26.608956 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 6989
I20260811 15:01:46.623368 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--webserver_interface=127.11.225.126
--webserver_port=41549
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:32859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:01:46.739053 7943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:46.739312 7943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:46.739351 7943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:46.743446 7943 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:01:46.743496 7943 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:01:46.743513 7943 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:01:46.743527 7943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:01:46.743582 7943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:46.743614 7943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:46.743647 7943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:01:46.743681 7943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:01:46.748953 7943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:32859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=41549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:46.750058 7943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:46.751116 7943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:46.765703 7953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:46.765724 7959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:46.765774 7943 server_base.cc:1034] running on GCE node
W20260811 15:01:46.765728 7952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:46.766624 7943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:46.767741 7943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:46.768930 7943 hybrid_clock.cc:648] HybridClock initialized: now 1786460506768912 us; error 29 us; skew 500 ppm
Aug 11 15:01:46 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460506, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:46.771766 7943 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:01:46.772712 7943 webserver.cc:460] Webserver started at http://127.11.225.126:41549/ using document root <none> and password file <none>
I20260811 15:01:46.773357 7943 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:46.773463 7943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:46.777385 7943 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:46.779611 7974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:46.780876 7943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:46.781054 7943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "09c56d6629a0428a8d525f6bf16e6f46"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "9d22566e12c6821f579c3db1244c4863"
server_key_iv: "9edc5290c261ef2cd3c7f68e8439ef8a"
server_key_version: "encryptionkey@0"
I20260811 15:01:46.781750 7943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:46.799664 7943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:46.802664 7943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:46.802874 7943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:46.810210 7943 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:32859
I20260811 15:01:46.810508 8061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:32859 every 8 connection(s)
I20260811 15:01:46.811342 7943 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:01:46.815869 8064 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:01:46.817601 8064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap starting.
I20260811 15:01:46.821414 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 7943
I20260811 15:01:46.821938 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:35533
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=43347
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:01:46.836558 8064 log.cc:824] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:46.845646 8064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:46.846052 8064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap complete.
I20260811 15:01:46.850374 8064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:46.850788 8064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Initialized, Role: FOLLOWER
I20260811 15:01:46.851332 8064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:46.851454 8064 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:01:46.851544 8064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:01:46.851666 8064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:01:46.853745 8064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:46.854094 8064 leader_election.cc:302] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09c56d6629a0428a8d525f6bf16e6f46; no voters:
I20260811 15:01:46.854420 8064 leader_election.cc:288] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:01:46.854573 8073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:01:46.854823 8073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 LEADER]: Becoming Leader. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Running, Role: LEADER
I20260811 15:01:46.855188 8073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:01:46.855616 8064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:01:46.856750 8074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:01:46.856784 8078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09c56d6629a0428a8d525f6bf16e6f46. Latest consensus state: current_term: 2 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:01:46.856879 8074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:46.856894 8078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:01:46.861653 8103 catalog_manager.cc:1259] Loaded cluster ID: 6e7864b92fee4491b73bab711739f81f
I20260811 15:01:46.861716 8103 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: loading cluster ID for follower catalog manager: success
I20260811 15:01:46.864238 8103 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: acquiring CA information for follower catalog manager: success
I20260811 15:01:46.865885 8103 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:01:46.866025 8081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:01:46.868605 8081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:01:46.869181 8081 catalog_manager.cc:1259] Loaded cluster ID: 6e7864b92fee4491b73bab711739f81f
I20260811 15:01:46.869266 8081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:01:46.869978 8081 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:01:46.870487 8081 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Loaded TSK: 0
I20260811 15:01:46.886910 8081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Generated new TSK 1
I20260811 15:01:46.887274 8081 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:01:46.944274 8068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:46.944540 8068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:46.944610 8068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:46.948741 8068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:46.948796 8068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:46.948875 8068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:01:46.954250 8068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:35533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=43347
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:46.955222 8068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:46.956270 8068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:46.966012 8118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:46.965994 8117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:46.965996 8120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:46.966470 8068 server_base.cc:1034] running on GCE node
I20260811 15:01:46.966866 8068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:46.967520 8068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:46.968708 8068 hybrid_clock.cc:648] HybridClock initialized: now 1786460506968683 us; error 43 us; skew 500 ppm
Aug 11 15:01:46 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460506, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:46.971719 8068 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:01:46.972697 8068 webserver.cc:460] Webserver started at http://127.11.225.65:43347/ using document root <none> and password file <none>
I20260811 15:01:46.973357 8068 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:46.973438 8068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:46.977450 8068 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:01:46.979614 8131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:46.980875 8068 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:01:46.980969 8068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "4b2839d49fce43509f00c2754be3ad48"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "17b4d3ace68dbdb71a92661114ba328b"
server_key_iv: "ef462df5342ee9621c9e38d19d18dddd"
server_key_version: "encryptionkey@0"
I20260811 15:01:46.981585 8068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:46.996812 8068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:46.999845 8068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:47.000065 8068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:47.000696 8068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:47.001945 8146 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:01:47.006115 8068 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:01:47.006175 8068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20260811 15:01:47.006243 8068 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:01:47.007848 8068 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:01:47.007927 8068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:01:47.008183 8146 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap starting.
I20260811 15:01:47.019074 8068 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:35533
I20260811 15:01:47.019105 8328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:35533 every 8 connection(s)
I20260811 15:01:47.020380 8068 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:01:47.029539 8146 log.cc:824] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:47.030416 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 8068
I20260811 15:01:47.030946 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:35203
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=45155
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460506, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:47.038261 8146 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:01:47.038714 8146 tablet_bootstrap.cc:492] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap complete.
I20260811 15:01:47.039904 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.022529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:53845)
0811 15:01:47.023302 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.023356 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.024178 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.025645 (+ 1467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.025652 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.026003 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:47.026481 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.026496 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.028611 (+ 2115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.028613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.029552 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.029563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.030723 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.030730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.030921 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.031735 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:47.031756 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:47.033626 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:47.036197 (+ 2571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.036203 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.036214 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.036573 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.037048 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.037051 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.037053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.037224 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.038017 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:47.038022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:47.038300 (+ 278us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.038499 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.038842 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":157,"threads_started":1}
I20260811 15:01:47.040045 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.022557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:53845 (local address 127.11.225.126:32859)
0811 15:01:47.022969 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.022989 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.023499 (+ 510us) server_negotiation.cc:407] Connection header received
0811 15:01:47.024667 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.024683 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.025130 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.025598 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.026666 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.028362 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.029699 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.030423 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.030618 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.033820 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.033825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.033839 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.033867 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.036069 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.036704 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.036714 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.036723 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.036914 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.037341 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.037346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.037351 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.037879 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.038048 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.038660 (+ 612us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.039047 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":130,"threads_started":1}
I20260811 15:01:47.040185 8146 ts_tablet_manager.cc:1397] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Time spent bootstrapping tablet: real 0.032s user 0.026s sys 0.004s
I20260811 15:01:47.042578 8332 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:47.042814 8332 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:47.042815 8146 raft_consensus.cc:348] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.043396 8146 raft_consensus.cc:729] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2839d49fce43509f00c2754be3ad48, State: Initialized, Role: FOLLOWER
I20260811 15:01:47.043433 8332 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
I20260811 15:01:47.043932 8146 consensus_queue.cc:260] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.044999 8146 ts_tablet_manager.cc:1428] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:01:47.046625 8006 ts_manager.cc:194] Registered new tserver with Master: 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533)
I20260811 15:01:47.050591 8006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:53845
I20260811 15:01:47.053357 8332 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460506, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.65@KRBTEST.COM
I20260811 15:01:47.060621 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.049927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35533 (local address 127.0.0.1:40980)
0811 15:01:47.050307 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.050350 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.050471 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.051216 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.051222 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.051664 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:47.051782 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.051789 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.052819 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.052823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.053579 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.053589 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.054420 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.054424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.054522 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.055098 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:47.055110 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:47.056756 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:47.058954 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.058962 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.058967 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.059210 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.059520 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.059522 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.059524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.059601 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.060116 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:47.060121 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:47.060221 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.060346 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.060488 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":116,"threads_started":1}
I20260811 15:01:47.060762 8343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.049974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.11.225.65:35533)
0811 15:01:47.050828 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.050838 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.050856 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:01:47.050909 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.050913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.051060 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.051210 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.051902 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.052701 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.053696 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.054194 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.054298 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.056911 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.056921 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.056934 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.056963 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.058844 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.059320 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.059327 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.059329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.059428 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.059683 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.059687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.059688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.059974 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.060138 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.060454 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.060616 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":747,"thread_start_us":104,"threads_started":1}
I20260811 15:01:47.061928 8214 tablet_service.cc:1514] Processing DeleteTablet for tablet ef93f4fbfd374ad3a86ff9eaf4a24374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:40980
I20260811 15:01:47.062754 8344 tablet_replica.cc:330] stopping tablet replica
I20260811 15:01:47.063045 8344 raft_consensus.cc:2229] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:47.063323 8344 raft_consensus.cc:2258] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:47.064357 8344 ts_tablet_manager.cc:1905] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:47.068022 8344 ts_tablet_manager.cc:1918] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:47.068135 8344 log.cc:1196] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal/wals/ef93f4fbfd374ad3a86ff9eaf4a24374
I20260811 15:01:47.068462 8344 ts_tablet_manager.cc:1939] T ef93f4fbfd374ad3a86ff9eaf4a24374 P 4b2839d49fce43509f00c2754be3ad48: Deleting consensus metadata
I20260811 15:01:47.070120 7977 catalog_manager.cc:4841] TS 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533): tablet ef93f4fbfd374ad3a86ff9eaf4a24374 (table test-table [id=6a7fac080bc7471db78c314b71bf67bd]) successfully deleted
W20260811 15:01:47.153635 8339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:47.153884 8339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:47.153952 8339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:47.158054 8339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:47.158110 8339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:47.158167 8339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:01:47.163540 8339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:35203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=45155
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:47.164494 8339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:47.165504 8339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:47.175464 8350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:47.175460 8351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:47.175511 8353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:47.175779 8339 server_base.cc:1034] running on GCE node
I20260811 15:01:47.176158 8339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:47.176812 8339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:47.177990 8339 hybrid_clock.cc:648] HybridClock initialized: now 1786460507177977 us; error 25 us; skew 500 ppm
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460507, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:47.180719 8339 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:01:47.181609 8339 webserver.cc:460] Webserver started at http://127.11.225.66:45155/ using document root <none> and password file <none>
I20260811 15:01:47.182139 8339 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:47.182220 8339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:47.186278 8339 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:01:47.188333 8362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.189620 8339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:01:47.189721 8339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c371e6d60baa44bf922eada3c1caa3cc"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "b8b4307667eba34dc6bcb82f3de96a5d"
server_key_iv: "82a95d31de25eb365a4bd1c38e22da3c"
server_key_version: "encryptionkey@0"
I20260811 15:01:47.190214 8339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:47.214174 8339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:47.217128 8339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:47.217370 8339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:47.217989 8339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:47.218794 8339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:47.218842 8339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.218881 8339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:47.218896 8339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.227936 8339 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35203
I20260811 15:01:47.227969 8587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35203 every 8 connection(s)
I20260811 15:01:47.228895 8339 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:01:47.230159 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 8339
I20260811 15:01:47.230690 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:33519
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=34515
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460507, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:47.248911 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.230702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:60073 (local address 127.11.225.126:32859)
0811 15:01:47.230861 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.230868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.231897 (+ 1029us) server_negotiation.cc:407] Connection header received
0811 15:01:47.233762 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.233765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.233817 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.233894 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.235286 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.235827 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.236994 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.237298 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.237411 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.245153 (+ 7742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.245156 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.245158 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.245186 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.246724 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.247265 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.247269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.247271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.247356 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.247733 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.247737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.247739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.247933 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.248099 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.248593 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.248732 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:01:47.249831 8593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.231205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:60073)
0811 15:01:47.231739 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.231782 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.233494 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.234104 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.234115 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.234639 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:47.235122 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.235136 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.235959 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.235963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.236855 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.236865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.237456 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.237460 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.237643 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.243434 (+ 5791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:47.243451 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:47.244937 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:47.246859 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.246865 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.246882 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.247156 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.247470 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.247473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.247476 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.247638 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.248094 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:47.248101 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:47.248351 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.248550 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.248879 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":152,"threads_started":1}
I20260811 15:01:47.251161 8589 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:47.251444 8589 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:47.251988 8589 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
I20260811 15:01:47.253115 8006 ts_manager.cc:194] Registered new tserver with Master: c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
I20260811 15:01:47.253911 8006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:60073
W20260811 15:01:47.347277 8594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:01:47.347529 8594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:01:47.347569 8594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:01:47.351557 8594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:01:47.351608 8594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:01:47.351661 8594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:01:47.357151 8594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:33519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=34515
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:01:47.358201 8594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:01:47.359357 8594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:01:47.375865 8604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:47.375888 8602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:01:47.375916 8599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:01:47.376124 8594 server_base.cc:1034] running on GCE node
I20260811 15:01:47.376588 8594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:01:47.377324 8594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:01:47.378515 8594 hybrid_clock.cc:648] HybridClock initialized: now 1786460507378483 us; error 51 us; skew 500 ppm
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460507, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:01:47.381312 8594 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:01:47.382134 8594 webserver.cc:460] Webserver started at http://127.11.225.67:34515/ using document root <none> and password file <none>
I20260811 15:01:47.382673 8594 fs_manager.cc:359] Metadata directory not provided
I20260811 15:01:47.382754 8594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:01:47.387115 8594 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 15:01:47.389132 8615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.390409 8594 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:01:47.390506 8594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "bea41e57c8484692937ebec4e93370d1"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "0ca5b7d1a6cbcf87f00d2fbdf8f69a41"
server_key_iv: "0c92876cdafc02817c43105dd6c3bfa8"
server_key_version: "encryptionkey@0"
I20260811 15:01:47.391016 8594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:01:47.405736 8594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:01:47.408562 8594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:01:47.408746 8594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:01:47.409373 8594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:01:47.410193 8594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:01:47.410255 8594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.410293 8594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:01:47.410315 8594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:01:47.419389 8594 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:33519
I20260811 15:01:47.419411 8816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:33519 every 8 connection(s)
I20260811 15:01:47.420352 8594 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:01:47.429675 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 8594
Aug 11 15:01:47 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460507, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:01:47.434106 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.422172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:53321 (local address 127.11.225.126:32859)
0811 15:01:47.422337 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.422342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.423238 (+ 896us) server_negotiation.cc:407] Connection header received
0811 15:01:47.424545 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.424548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.424597 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.424672 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.425810 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.426325 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.427403 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.427643 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.427724 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.430418 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.430422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.430425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.430453 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.431970 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.432535 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.432538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.432539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.432618 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.432977 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.432981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.432982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.433271 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.433370 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.433865 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.433971 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:01:47.435053 8820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.422607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:53321)
0811 15:01:47.423073 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.423116 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.424340 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.424834 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.424840 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.425182 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:01:47.425671 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.425684 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.426439 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.426442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.427294 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.427303 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.427771 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.427773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.427908 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.428525 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:01:47.428547 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:01:47.430198 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:01:47.432083 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.432088 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.432103 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.432434 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.432705 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:01:47.432711 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:01:47.432716 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:01:47.432875 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:01:47.433369 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:01:47.433374 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:01:47.433610 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.433811 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.434168 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":134,"threads_started":1}
I20260811 15:01:47.436556 8817 heartbeater.cc:347] Connected to a master server at 127.11.225.126:32859
I20260811 15:01:47.436805 8817 heartbeater.cc:464] Registering TS with master...
I20260811 15:01:47.437381 8817 heartbeater.cc:511] Master 127.11.225.126:32859 requested a full tablet report, sending...
I20260811 15:01:47.438467 8006 ts_manager.cc:194] Registered new tserver with Master: bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519)
I20260811 15:01:47.439225 8006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:53321
I20260811 15:01:47.439249 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.430458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33974 (local address 127.11.225.126:32859)
0811 15:01:47.430687 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.430691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.430874 (+ 183us) server_negotiation.cc:407] Connection header received
0811 15:01:47.431043 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.431045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.431085 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.431173 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.431888 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.432631 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.433724 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.434083 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.434191 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.435752 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.435756 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.435759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.435787 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.437504 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.437938 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.437941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.437943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.438034 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.438371 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.438374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.438375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.438546 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.438739 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.438937 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.439062 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":83,"threads_started":1}
I20260811 15:01:47.441087 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:01:47.445363 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.441757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33986 (local address 127.11.225.126:32859)
0811 15:01:47.441896 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.441899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.442116 (+ 217us) server_negotiation.cc:407] Connection header received
0811 15:01:47.442288 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.442295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.442382 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.442512 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:47.442741 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.443265 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.444192 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.444426 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.444533 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.444841 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:47.444965 (+ 124us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 15:01:47.445215 (+ 250us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33986: token expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 15:01:47.445433 8821 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33986: token expired
W20260811 15:01:47.445744 7878 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.225.126:32859)
I20260811 15:01:47.452865 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.446217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34000 (local address 127.11.225.126:32859)
0811 15:01:47.446328 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.446332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.446345 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:01:47.446409 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.446413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.446451 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.446533 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:01:47.447159 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.447617 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.448445 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.448664 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.448764 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.450099 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:01:47.450103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:01:47.450105 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:01:47.450132 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:01:47.451370 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.451807 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.451810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.451811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.451895 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:01:47.452163 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:01:47.452165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:01:47.452166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:01:47.452326 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:01:47.452426 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.452667 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.452760 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 15:01:47.455214 8006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:01:47.458680 8006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:01:47.467509 8214 tablet_service.cc:1467] Processing CreateTablet for tablet 602455e4840c422f9d5eef2d72587b54 (DEFAULT_TABLE table=test-table [id=2ef2e703c78849f88e40c797e490f25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:47.468046 8214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602455e4840c422f9d5eef2d72587b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:47.470616 8146 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap starting.
I20260811 15:01:47.471037 8342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.466187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:33519 (local address 127.0.0.1:59022)
0811 15:01:47.466440 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.466456 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.466540 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.467209 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.467212 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.467231 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:47.467350 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.467357 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.468437 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.468441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.469303 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.469314 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.470557 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.470561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.470730 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.470781 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.470836 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.470909 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260811 15:01:47.471529 8146 tablet_bootstrap.cc:654] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:47.471887 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.466369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59022 (local address 127.11.225.67:33519)
0811 15:01:47.466782 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.466791 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.466811 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:01:47.466880 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.466884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.467062 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.467230 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:47.467450 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.468326 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.469464 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.470384 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.471400 (+ 1016us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.471575 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.471633 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.471751 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":162,"threads_started":1}
I20260811 15:01:47.474674 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.466949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.11.225.66:35203)
0811 15:01:47.469616 (+ 2667us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.469627 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.469649 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:01:47.469723 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.469728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.469919 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.470083 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:47.470347 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.471989 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.473187 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.474045 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.474157 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.474294 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.474437 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.474527 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2532,"thread_start_us":158,"threads_started":1}
I20260811 15:01:47.474749 8832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.466380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35203 (local address 127.0.0.1:53318)
0811 15:01:47.466640 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.466656 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.466752 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.470073 (+ 3321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.470076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.470097 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:47.470214 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.470220 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.472142 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.472145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.473066 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.473076 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.474157 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.474161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.474267 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.474291 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.474412 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.474622 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":133,"threads_started":1}
I20260811 15:01:47.475144 8689 tablet_service.cc:1467] Processing CreateTablet for tablet 602455e4840c422f9d5eef2d72587b54 (DEFAULT_TABLE table=test-table [id=2ef2e703c78849f88e40c797e490f25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:47.476102 8689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602455e4840c422f9d5eef2d72587b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:47.477862 8146 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: No bootstrap required, opened a new log
I20260811 15:01:47.477982 8146 ts_tablet_manager.cc:1397] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 15:01:47.478494 8146 raft_consensus.cc:348] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.478641 8146 raft_consensus.cc:374] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:47.478680 8146 raft_consensus.cc:729] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2839d49fce43509f00c2754be3ad48, State: Initialized, Role: FOLLOWER
I20260811 15:01:47.478811 8146 consensus_queue.cc:260] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.479074 8146 ts_tablet_manager.cc:1428] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 15:01:47.480454 8469 tablet_service.cc:1467] Processing CreateTablet for tablet 602455e4840c422f9d5eef2d72587b54 (DEFAULT_TABLE table=test-table [id=2ef2e703c78849f88e40c797e490f25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:01:47.481664 8469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 602455e4840c422f9d5eef2d72587b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:01:47.484093 8838 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Bootstrap starting.
I20260811 15:01:47.486446 8838 tablet_bootstrap.cc:654] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:47.487741 8838 log.cc:824] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:47.488888 8842 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Bootstrap starting.
I20260811 15:01:47.490164 8838 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: No bootstrap required, opened a new log
I20260811 15:01:47.490356 8838 ts_tablet_manager.cc:1397] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:01:47.491639 8842 tablet_bootstrap.cc:654] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Neither blocks nor log segments found. Creating new log.
I20260811 15:01:47.492568 8842 log.cc:824] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Log is configured to *not* fsync() on all Append() calls
I20260811 15:01:47.494529 8838 raft_consensus.cc:348] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.494796 8842 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: No bootstrap required, opened a new log
I20260811 15:01:47.494840 8838 raft_consensus.cc:374] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:47.494889 8838 raft_consensus.cc:729] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea41e57c8484692937ebec4e93370d1, State: Initialized, Role: FOLLOWER
I20260811 15:01:47.494980 8842 ts_tablet_manager.cc:1397] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:01:47.495350 8838 consensus_queue.cc:260] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.496028 8817 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
I20260811 15:01:47.496366 8838 ts_tablet_manager.cc:1428] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:01:47.498917 8842 raft_consensus.cc:348] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.499197 8842 raft_consensus.cc:374] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:01:47.499281 8842 raft_consensus.cc:729] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c371e6d60baa44bf922eada3c1caa3cc, State: Initialized, Role: FOLLOWER
I20260811 15:01:47.499737 8842 consensus_queue.cc:260] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.500379 8589 heartbeater.cc:503] Master 127.11.225.126:32859 was elected leader, sending a full tablet report...
I20260811 15:01:47.500579 8842 ts_tablet_manager.cc:1428] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260811 15:01:47.521638 8333 tablet.cc:2369] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:47.611852 8340 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:01:47.612178 8340 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.613404 8340 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
I20260811 15:01:47.617522 8836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.613827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:48611 (local address 127.11.225.66:35203)
0811 15:01:47.613968 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.613973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.614300 (+ 327us) server_negotiation.cc:407] Connection header received
0811 15:01:47.614460 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.614463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.614514 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.614594 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:47.614883 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.615413 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.616522 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.616901 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.617021 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.617076 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.617329 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.617398 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:01:47.617532 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.613858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:59525 (local address 127.11.225.67:33519)
0811 15:01:47.614047 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.614053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.614241 (+ 188us) server_negotiation.cc:407] Connection header received
0811 15:01:47.614455 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.614458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.614507 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.614591 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:01:47.614879 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.615408 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.616526 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.616917 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.617060 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.617110 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.617341 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.617408 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:01:47.617547 8847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.613702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35203 (local address 127.11.225.65:48611)
0811 15:01:47.614193 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.614206 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.614345 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.614617 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.614620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.614636 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:47.614774 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.614779 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.615527 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.615530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.616391 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.616401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.617022 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.617025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.617120 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.617200 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.617310 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.617384 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":285,"thread_start_us":97,"threads_started":1}
I20260811 15:01:47.617584 8846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.613702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:33519 (local address 127.11.225.65:59525)
0811 15:01:47.614137 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.614150 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:01:47.614308 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:01:47.614606 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:01:47.614608 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:01:47.614625 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:01:47.614769 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.614775 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.615531 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.615534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.616393 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:01:47.616403 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.617055 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.617059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:01:47.617164 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.617234 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 15:01:47.617321 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 15:01:47.617398 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":67,"spinlock_wait_cycles":11520,"thread_start_us":115,"threads_started":1}
I20260811 15:01:47.618264 8724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602455e4840c422f9d5eef2d72587b54" candidate_uuid: "4b2839d49fce43509f00c2754be3ad48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea41e57c8484692937ebec4e93370d1" is_pre_election: true
I20260811 15:01:47.618474 8503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602455e4840c422f9d5eef2d72587b54" candidate_uuid: "4b2839d49fce43509f00c2754be3ad48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c371e6d60baa44bf922eada3c1caa3cc" is_pre_election: true
I20260811 15:01:47.618590 8724 raft_consensus.cc:2454] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2839d49fce43509f00c2754be3ad48 in term 0.
I20260811 15:01:47.618789 8503 raft_consensus.cc:2454] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b2839d49fce43509f00c2754be3ad48 in term 0.
I20260811 15:01:47.619335 8136 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48, bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc; no voters:
I20260811 15:01:47.619604 8340 raft_consensus.cc:2781] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:01:47.619688 8340 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:01:47.619730 8340 raft_consensus.cc:3037] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:47.620782 8340 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.621193 8340 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 1 election: Requested vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
I20260811 15:01:47.621556 8724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602455e4840c422f9d5eef2d72587b54" candidate_uuid: "4b2839d49fce43509f00c2754be3ad48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea41e57c8484692937ebec4e93370d1"
I20260811 15:01:47.621598 8503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "602455e4840c422f9d5eef2d72587b54" candidate_uuid: "4b2839d49fce43509f00c2754be3ad48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c371e6d60baa44bf922eada3c1caa3cc"
I20260811 15:01:47.621675 8724 raft_consensus.cc:3037] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:47.621737 8503 raft_consensus.cc:3037] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:01:47.622725 8724 raft_consensus.cc:2454] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2839d49fce43509f00c2754be3ad48 in term 1.
I20260811 15:01:47.622907 8503 raft_consensus.cc:2454] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b2839d49fce43509f00c2754be3ad48 in term 1.
I20260811 15:01:47.623078 8138 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48, bea41e57c8484692937ebec4e93370d1; no voters:
I20260811 15:01:47.623289 8340 raft_consensus.cc:2781] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:01:47.623481 8340 raft_consensus.cc:686] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 LEADER]: Becoming Leader. State: Replica: 4b2839d49fce43509f00c2754be3ad48, State: Running, Role: LEADER
I20260811 15:01:47.623790 8340 consensus_queue.cc:237] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:01:47.626699 8005 catalog_manager.cc:5495] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65). New cstate: current_term: 1 leader_uuid: "4b2839d49fce43509f00c2754be3ad48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } health_report { overall_health: HEALTHY } } }
I20260811 15:01:47.665766 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.661975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.11.225.65:35533)
0811 15:01:47.662283 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 15:01:47.662292 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:01:47.662311 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:01:47.662388 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:01:47.662390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:01:47.662443 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:01:47.662572 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:01:47.662837 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.663353 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.664197 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:01:47.664422 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:01:47.664527 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:01:47.664818 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:01:47.665355 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:01:47.665478 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:01:47.665536 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 15:01:47.665590 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
I20260811 15:01:47.669867 8503 raft_consensus.cc:1261] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Refusing update from remote peer 4b2839d49fce43509f00c2754be3ad48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:47.669869 8724 raft_consensus.cc:1261] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Refusing update from remote peer 4b2839d49fce43509f00c2754be3ad48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:01:47.670583 8340 consensus_queue.cc:1035] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:01:47.670790 8849 consensus_queue.cc:1035] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 15:01:47.671308 8818 tablet.cc:2369] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:01:47.678752 8858 mvcc.cc:205] Tried to move back new op lower bound from 7317342239409414144 to 7317342239229505536. Current Snapshot: MvccSnapshot[applied={T|T < 7317342239409414144}]
I20260811 15:01:47.679255 8859 mvcc.cc:205] Tried to move back new op lower bound from 7317342239409414144 to 7317342239229505536. Current Snapshot: MvccSnapshot[applied={T|T < 7317342239409414144}]
I20260811 15:01:47.687340 8005 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:47.687525 8005 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:01:47.690085 8005 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Sending DeleteTablet for 3 replicas of tablet 602455e4840c422f9d5eef2d72587b54
I20260811 15:01:47.690745 8689 tablet_service.cc:1514] Processing DeleteTablet for tablet 602455e4840c422f9d5eef2d72587b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:47 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:59022
I20260811 15:01:47.690958 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 8068
I20260811 15:01:47.690955 8469 tablet_service.cc:1514] Processing DeleteTablet for tablet 602455e4840c422f9d5eef2d72587b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:01:47 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:53318
I20260811 15:01:47.701725 8878 tablet_replica.cc:330] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: stopping tablet replica
I20260811 15:01:47.702121 8878 raft_consensus.cc:2229] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:47.702487 8878 raft_consensus.cc:2258] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:47.702960 8873 tablet_replica.cc:330] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: stopping tablet replica
I20260811 15:01:47.703323 8873 raft_consensus.cc:2229] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:01:47.703652 8873 raft_consensus.cc:2258] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:01:47.704698 8878 ts_tablet_manager.cc:1905] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:47.705021 8873 ts_tablet_manager.cc:1905] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:01:47.707366 8873 ts_tablet_manager.cc:1918] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:47.707484 8873 log.cc:1196] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/602455e4840c422f9d5eef2d72587b54
I20260811 15:01:47.707903 8873 ts_tablet_manager.cc:1939] T 602455e4840c422f9d5eef2d72587b54 P bea41e57c8484692937ebec4e93370d1: Deleting consensus metadata
I20260811 15:01:47.708235 8878 ts_tablet_manager.cc:1918] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:01:47.708335 8878 log.cc:1196] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/602455e4840c422f9d5eef2d72587b54
I20260811 15:01:47.708657 8878 ts_tablet_manager.cc:1939] T 602455e4840c422f9d5eef2d72587b54 P c371e6d60baa44bf922eada3c1caa3cc: Deleting consensus metadata
I20260811 15:01:47.709255 7978 catalog_manager.cc:4841] TS bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): tablet 602455e4840c422f9d5eef2d72587b54 (table test-table [id=2ef2e703c78849f88e40c797e490f25b]) successfully deleted
W20260811 15:01:47.709348 7977 connection.cc:535] client connection to 127.11.225.65:35533 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 15:01:47.709501 7977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:01:47.709909 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 8339
I20260811 15:01:47.710016 7977 catalog_manager.cc:4841] TS c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): tablet 602455e4840c422f9d5eef2d72587b54 (table test-table [id=2ef2e703c78849f88e40c797e490f25b]) successfully deleted
I20260811 15:01:47.715994 8832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:01:47.715504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:35533 (local address 127.0.0.1:41008)
0811 15:01:47.715770 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 15:01:47.715874 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260811 15:01:47.716221 7977 catalog_manager.cc:4584] TS 4b2839d49fce43509f00c2754be3ad48 (127.11.225.65:35533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 602455e4840c422f9d5eef2d72587b54: Network error: Client connection negotiation failed: client connection to 127.11.225.65:35533: connect: Connection refused (error 111)
I20260811 15:01:47.726449 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 8594
I20260811 15:01:47.739586 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 7943
I20260811 15:02:07.752218 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--webserver_interface=127.11.225.126
--webserver_port=41549
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:32859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:07.869419 8880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:07.869767 8880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:07.869859 8880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:07.874082 8880 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:02:07.874158 8880 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:02:07.874202 8880 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:02:07.874228 8880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:07.874291 8880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:07.874336 8880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:07.874373 8880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:07.874408 8880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:07.879890 8880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:32859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:32859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=41549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:07.881304 8880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:07.882409 8880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:07.891887 8893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:07.891920 8890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:07.892092 8880 server_base.cc:1034] running on GCE node
W20260811 15:02:07.891920 8888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:07.892829 8880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:07.894083 8880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:07.895296 8880 hybrid_clock.cc:648] HybridClock initialized: now 1786460527895276 us; error 36 us; skew 500 ppm
Aug 11 15:02:07 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:07.903306 8880 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:07.904405 8880 webserver.cc:460] Webserver started at http://127.11.225.126:41549/ using document root <none> and password file <none>
I20260811 15:02:07.905089 8880 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:07.905201 8880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:07.909714 8880 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:07.912173 8903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:07.913722 8880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:07.913880 8880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "09c56d6629a0428a8d525f6bf16e6f46"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "9d22566e12c6821f579c3db1244c4863"
server_key_iv: "9edc5290c261ef2cd3c7f68e8439ef8a"
server_key_version: "encryptionkey@0"
I20260811 15:02:07.914489 8880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:07.945331 8880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:07.948954 8880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:07.949196 8880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:07.957187 8880 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:32859
I20260811 15:02:07.957561 8998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:32859 every 8 connection(s)
I20260811 15:02:07.958536 8880 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:07.960989 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 8880
I20260811 15:02:07.961549 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:35533
--local_ip_for_outbound_sockets=127.11.225.65
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=43347
--webserver_interface=127.11.225.65
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:02:07.963603 9001 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:02:07.966262 9001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap starting.
I20260811 15:02:07.993280 9001 log.cc:824] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:08.010010 9001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:02:08.010612 9001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Bootstrap complete.
I20260811 15:02:08.015698 9001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:02:08.016175 9001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Initialized, Role: FOLLOWER
I20260811 15:02:08.016839 9001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:02:08.017055 9001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:08.017160 9001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:08.017336 9001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 2 FOLLOWER]: Advancing to term 3
I20260811 15:02:08.020321 9001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:02:08.020732 9001 leader_election.cc:302] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09c56d6629a0428a8d525f6bf16e6f46; no voters:
I20260811 15:02:08.021102 9001 leader_election.cc:288] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 15:02:08.021329 9007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 15:02:08.021704 9007 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [term 3 LEADER]: Becoming Leader. State: Replica: 09c56d6629a0428a8d525f6bf16e6f46, State: Running, Role: LEADER
I20260811 15:02:08.022181 9007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } }
I20260811 15:02:08.022456 9001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:08.024493 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09c56d6629a0428a8d525f6bf16e6f46. Latest consensus state: current_term: 3 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:02:08.024704 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:08.024398 9009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "09c56d6629a0428a8d525f6bf16e6f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09c56d6629a0428a8d525f6bf16e6f46" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 32859 } } }
I20260811 15:02:08.025089 9009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:08.025468 9020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:08.030915 9020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:08.031756 9020 catalog_manager.cc:1259] Loaded cluster ID: 6e7864b92fee4491b73bab711739f81f
I20260811 15:02:08.031823 9020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:08.034518 9020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:08.035319 9020 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Loaded TSK: 0
I20260811 15:02:08.035413 9020 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09c56d6629a0428a8d525f6bf16e6f46: Loaded TSK: 1
F20260811 15:02:08.036295 9020 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5b94fbb9ad google::LogMessage::Fail() at ??:0
@ 0x7f5b94fbe88a google::LogMessage::SendToLog() at ??:0
@ 0x7f5b94fbb4de google::LogMessage::Flush() at ??:0
@ 0x7f5b94fbca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5b97c7f18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5b97c77f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f5b9f9207bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f5b9f8fa99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5b9f8fb178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f5b9f93cdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f5b9f95b82b std::function<>::operator()() at ??:0
@ 0x7f5b9f8fab4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f5b9f8fbf3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5b9f8f8579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f5b9f93c640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5b9720d3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5b9720dc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f5b9720f3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f5b971fe512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5b988426db start_thread at ??:0
@ 0x7f5b93ab961f clone at ??:0
W20260811 15:02:08.132802 9003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:08.133121 9003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:08.133278 9003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:08.137501 9003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:08.137595 9003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:08.137730 9003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:08.143461 9003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:35533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=43347
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:08.144797 9003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:08.146006 9003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:08.156847 9074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:08.156937 9003 server_base.cc:1034] running on GCE node
W20260811 15:02:08.156872 9073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:08.157145 9076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:08.157722 9003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:08.158448 9003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:08.159646 9003 hybrid_clock.cc:648] HybridClock initialized: now 1786460528159607 us; error 52 us; skew 500 ppm
Aug 11 15:02:08 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460528, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:08.162717 9003 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:02:08.163642 9003 webserver.cc:460] Webserver started at http://127.11.225.65:43347/ using document root <none> and password file <none>
I20260811 15:02:08.164243 9003 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:08.164338 9003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:08.168577 9003 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:02:08.171123 9086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.172557 9003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:02:08.172735 9003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "4b2839d49fce43509f00c2754be3ad48"
format_stamp: "Formatted at 2026-08-11 15:01:25 on dist-test-slave-8hhm"
server_key: "17b4d3ace68dbdb71a92661114ba328b"
server_key_iv: "ef462df5342ee9621c9e38d19d18dddd"
server_key_version: "encryptionkey@0"
I20260811 15:02:08.173408 9003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:08.188975 9003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:08.193081 9003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:08.193369 9003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:08.194085 9003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:08.195346 9094 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:02:08.201287 9003 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:02:08.201393 9003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260811 15:02:08.201478 9003 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:02:08.203325 9003 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:02:08.203413 9003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:02:08.203715 9094 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap starting.
I20260811 15:02:08.215502 9003 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:35533
I20260811 15:02:08.215736 9285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:35533 every 8 connection(s)
I20260811 15:02:08.216639 9003 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:08.221997 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 9003
I20260811 15:02:08.222505 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:35203
--local_ip_for_outbound_sockets=127.11.225.66
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=45155
--webserver_interface=127.11.225.66
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:02:08.226471 9094 log.cc:824] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:08.236097 9094 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:02:08.236567 9094 tablet_bootstrap.cc:492] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Bootstrap complete.
I20260811 15:02:08.238143 9094 ts_tablet_manager.cc:1397] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Time spent bootstrapping tablet: real 0.035s user 0.021s sys 0.012s
I20260811 15:02:08.241808 9094 raft_consensus.cc:348] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:08.242389 9094 raft_consensus.cc:729] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2839d49fce43509f00c2754be3ad48, State: Initialized, Role: FOLLOWER
I20260811 15:02:08.242921 9094 consensus_queue.cc:260] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:08.244036 9094 ts_tablet_manager.cc:1428] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260811 15:02:08.297125 9288 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:02:08.218761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:36349)
0811 15:02:08.219296 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.219355 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:08.220214 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:08.296223 (+ 76009us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":174,"threads_started":1}
W20260811 15:02:08.297756 9286 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:32859 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:32859: Client connection negotiation failed: client connection to 127.11.225.126:32859: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:02:08.298581 9288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.298320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:36055)
0811 15:02:08.298459 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.298523 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 15:02:08.299310 9288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.299110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:45191)
0811 15:02:08.299219 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.299262 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 15:02:08.299578 9286 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:02:08.350302 9289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:08.350608 9289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:08.350683 9289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:08.354735 9289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:08.354822 9289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:08.354933 9289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:08.360039 9289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:35203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=45155
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:08.361083 9289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:08.362108 9289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:08.371855 9303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:08.371860 9307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:08.371855 9304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:08.372233 9289 server_base.cc:1034] running on GCE node
I20260811 15:02:08.372767 9289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:08.373512 9289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:08.374702 9289 hybrid_clock.cc:648] HybridClock initialized: now 1786460528374647 us; error 69 us; skew 500 ppm
Aug 11 15:02:08 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460528, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:08.377768 9289 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:02:08.378677 9289 webserver.cc:460] Webserver started at http://127.11.225.66:45155/ using document root <none> and password file <none>
I20260811 15:02:08.379230 9289 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:08.379298 9289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:08.383481 9289 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:02:08.385700 9320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.387069 9289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:08.387225 9289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "c371e6d60baa44bf922eada3c1caa3cc"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "b8b4307667eba34dc6bcb82f3de96a5d"
server_key_iv: "82a95d31de25eb365a4bd1c38e22da3c"
server_key_version: "encryptionkey@0"
I20260811 15:02:08.387812 9289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:08.413436 9289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:08.417320 9289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:08.417567 9289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:08.418269 9289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:08.419230 9289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:08.419309 9289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.419389 9289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:08.419445 9289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.429898 9289 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35203
I20260811 15:02:08.430266 9509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35203 every 8 connection(s)
I20260811 15:02:08.431119 9289 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:08.435343 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.433919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:55229)
0811 15:02:08.434473 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.434600 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":124,"threads_started":1}
W20260811 15:02:08.435847 9510 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:32859 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:32859: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
I20260811 15:02:08.436480 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.436254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:54547)
0811 15:02:08.436374 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.436423 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 15:02:08.437284 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.437042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:54257)
0811 15:02:08.437139 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.437182 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 15:02:08.437507 9510 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:02:08.441468 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 9289
I20260811 15:02:08.441943 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:33519
--local_ip_for_outbound_sockets=127.11.225.67
--tserver_master_addrs=127.11.225.126:32859
--webserver_port=34515
--webserver_interface=127.11.225.67
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:33045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:08.560330 9515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:08.560658 9515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:08.560735 9515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:08.564828 9515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:08.564924 9515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:08.565019 9515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:08.570415 9515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:33045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:33519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=34515
--tserver_master_addrs=127.11.225.126:32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:08.571497 9515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:08.572582 9515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:08.582985 9524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:08.583038 9522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:08.583066 9521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:08.583297 9515 server_base.cc:1034] running on GCE node
I20260811 15:02:08.583690 9515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:08.584321 9515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:08.585484 9515 hybrid_clock.cc:648] HybridClock initialized: now 1786460528585473 us; error 35 us; skew 500 ppm
Aug 11 15:02:08 dist-test-slave-8hhm krb5kdc[6961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460528, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:08.588275 9515 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:02:08.589177 9515 webserver.cc:460] Webserver started at http://127.11.225.67:34515/ using document root <none> and password file <none>
I20260811 15:02:08.589818 9515 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:08.589880 9515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:08.594285 9515 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 15:02:08.596633 9536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.598268 9515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:02:08.598388 9515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "bea41e57c8484692937ebec4e93370d1"
format_stamp: "Formatted at 2026-08-11 15:01:26 on dist-test-slave-8hhm"
server_key: "0ca5b7d1a6cbcf87f00d2fbdf8f69a41"
server_key_iv: "0c92876cdafc02817c43105dd6c3bfa8"
server_key_version: "encryptionkey@0"
I20260811 15:02:08.598953 9515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:08.610968 9515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:08.613929 9515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:08.614135 9515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:08.614718 9515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:08.615533 9515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:08.615581 9515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.615650 9515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:08.615691 9515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:08.624723 9515 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:33519
I20260811 15:02:08.624768 9735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:33519 every 8 connection(s)
I20260811 15:02:08.625785 9515 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:08.629657 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.627834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:47917)
0811 15:02:08.628311 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.628419 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":128,"threads_started":1}
W20260811 15:02:08.630200 9736 heartbeater.cc:644] Failed to heartbeat to 127.11.225.126:32859 (0 consecutive failures): Network error: Failed to ping master at 127.11.225.126:32859: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
I20260811 15:02:08.630376 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 9515
I20260811 15:02:08.630815 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.630609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:59325)
0811 15:02:08.630717 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.630763 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 15:02:08.631511 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:08.631269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:39177)
0811 15:02:08.631390 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:08.631445 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 15:02:08.631748 9736 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:02:09.300870 9740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.300349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:48765)
0811 15:02:09.300687 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:09.300752 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":82,"threads_started":1}
I20260811 15:02:09.438601 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.438110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:34009)
0811 15:02:09.438389 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:09.438486 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":73,"threads_started":1}
I20260811 15:02:09.569103 9745 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:09.569398 9745 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:09.570492 9745 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
Aug 11 15:02:09 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460528, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.66@KRBTEST.COM
Aug 11 15:02:09 dist-test-slave-8hhm krb5kdc[6961](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460528, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.67@KRBTEST.COM
I20260811 15:02:09.587750 9740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.570737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:33519 (local address 127.11.225.65:36433)
0811 15:02:09.570941 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:09.570955 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:09.571070 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:09.573291 (+ 2221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:09.573298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:09.573962 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:09.574731 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:09.574753 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.576773 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.576780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:09.577915 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:09.577928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.578804 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:09.579025 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:09.579744 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:09.579768 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:09.581871 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:09.584445 (+ 2574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:09.584452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:09.584468 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:09.585015 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:09.585486 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585489 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:09.585491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:09.585694 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:09.586499 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:09.586506 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:09.586881 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 15:02:09.587105 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 15:02:09.587565 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":421,"spinlock_wait_cycles":61696}
I20260811 15:02:09.587821 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.570931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:51297 (local address 127.11.225.66:35203)
0811 15:02:09.571315 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:09.571344 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:09.571391 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:02:09.572335 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:09.572345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:09.572815 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:09.573163 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:09.574958 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.576558 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578086 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.578643 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578813 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:09.581800 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:09.581807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:09.581819 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:09.581848 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:09.584293 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585175 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:09.585182 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:09.585188 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:09.585377 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585808 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:09.585811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:09.585813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:09.586358 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:09.586505 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:09.587283 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 15:02:09.587597 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":110,"threads_started":1}
I20260811 15:02:09.587821 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.570943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:36433 (local address 127.11.225.67:33519)
0811 15:02:09.571399 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:09.571409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:09.571439 (+ 30us) server_negotiation.cc:407] Connection header received
0811 15:02:09.572335 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:09.572345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:09.572814 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:09.573163 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:09.574958 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.576558 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578088 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.578658 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578835 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:09.582140 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:09.582148 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:09.582164 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:09.582204 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:09.584285 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585175 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:09.585182 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:09.585188 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:09.585377 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585808 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:09.585811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:09.585813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:09.586358 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:09.586503 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:09.587283 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 15:02:09.587597 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":91,"threads_started":1}
I20260811 15:02:09.587752 9748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.570761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35203 (local address 127.11.225.65:51297)
0811 15:02:09.571104 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:09.571118 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:09.571222 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:09.573291 (+ 2069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:09.573298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:09.573962 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:09.574731 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:09.574753 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.576766 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.576769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:09.577916 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:09.577927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:09.578775 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:09.578778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:09.579006 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:09.579654 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:09.579669 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:09.581558 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:09.584445 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:09.584452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:09.584468 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:09.585015 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:09.585494 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:09.585497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:09.585499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:09.585694 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:09.586500 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:09.586506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:09.586881 (+ 375us) client_negotiation.cc:769] Sending connection context
0811 15:02:09.587105 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 15:02:09.587505 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":198,"spinlock_wait_cycles":44160,"thread_start_us":81,"threads_started":1}
W20260811 15:02:09.590737 9089 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
W20260811 15:02:09.591435 9091 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
I20260811 15:02:09.591539 9091 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48; no voters: bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc
I20260811 15:02:09.591868 9745 raft_consensus.cc:2726] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:02:09.633028 9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:09.632509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:51889)
0811 15:02:09.632865 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:09.632924 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":104,"threads_started":1}
I20260811 15:02:10.302304 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:10.301858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:59695)
0811 15:02:10.302136 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:10.302203 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260811 15:02:10.439878 9758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:10.439432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:38455)
0811 15:02:10.439708 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:10.439764 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260811 15:02:10.634243 9759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:10.633814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:50805)
0811 15:02:10.634077 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:10.634133 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":75,"threads_started":1}
I20260811 15:02:11.303717 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:11.303209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:36181)
0811 15:02:11.303551 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:11.303614 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":129,"threads_started":1}
I20260811 15:02:11.441200 9761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:11.440757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:34949)
0811 15:02:11.441041 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:11.441100 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":112,"threads_started":1}
I20260811 15:02:11.487679 9762 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:11.487815 9762 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:11.488317 9762 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
W20260811 15:02:11.489287 9091 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
W20260811 15:02:11.489380 9089 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
I20260811 15:02:11.489492 9089 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48; no voters: bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc
I20260811 15:02:11.489728 9762 raft_consensus.cc:2726] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:02:11.635404 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:11.635005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:44973)
0811 15:02:11.635250 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:11.635312 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
I20260811 15:02:12.305035 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:12.304604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:55043)
0811 15:02:12.304867 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:12.304925 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":80,"threads_started":1}
I20260811 15:02:12.442781 9766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:12.442266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:40821)
0811 15:02:12.442585 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:12.442663 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":110,"threads_started":1}
I20260811 15:02:12.636605 9767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:12.636201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:40967)
0811 15:02:12.636453 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:12.636509 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":78,"threads_started":1}
I20260811 15:02:13.306413 9768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:13.305932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:35079)
0811 15:02:13.306255 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:13.306314 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":84,"threads_started":1}
I20260811 15:02:13.367126 9770 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:13.367298 9770 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:13.367753 9770 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
W20260811 15:02:13.368799 9089 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
W20260811 15:02:13.368913 9091 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
I20260811 15:02:13.368983 9091 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48; no voters: bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc
I20260811 15:02:13.369125 9770 raft_consensus.cc:2726] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:02:13.444113 9771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:13.443659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:37617)
0811 15:02:13.443952 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:13.444016 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":83,"threads_started":1}
I20260811 15:02:13.637861 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:13.637444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:32951)
0811 15:02:13.637706 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:13.637764 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
I20260811 15:02:14.307670 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:14.307234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:44489)
0811 15:02:14.307499 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:14.307559 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260811 15:02:14.445464 9774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:14.444951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:46729)
0811 15:02:14.445307 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:14.445364 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":127,"threads_started":1}
I20260811 15:02:14.639117 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:14.638643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:35495)
0811 15:02:14.638945 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:14.639014 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":82,"threads_started":1}
I20260811 15:02:15.308920 9778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:15.308468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:39063)
0811 15:02:15.308755 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:15.308817 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260811 15:02:15.446753 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:15.446217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:55953)
0811 15:02:15.446584 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:15.446647 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":93,"threads_started":1}
I20260811 15:02:15.640497 9780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:15.639995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:57545)
0811 15:02:15.640336 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:15.640397 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":79,"threads_started":1}
I20260811 15:02:16.310261 9781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:16.309825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:44827)
0811 15:02:16.310097 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:16.310161 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":81,"threads_started":1}
I20260811 15:02:16.448047 9782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:16.447582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:57761)
0811 15:02:16.447852 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:16.447911 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":81,"threads_started":1}
I20260811 15:02:16.642127 9783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:16.641556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:53439)
0811 15:02:16.641922 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:16.641989 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":116,"threads_started":1}
I20260811 15:02:17.311721 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:17.311174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:50493)
0811 15:02:17.311536 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:17.311604 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":102,"threads_started":1}
I20260811 15:02:17.451653 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:17.451173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:59183)
0811 15:02:17.451475 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:17.451546 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":116,"threads_started":1}
I20260811 15:02:17.643407 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:17.642905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:38183)
0811 15:02:17.643248 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:17.643307 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":85,"threads_started":1}
I20260811 15:02:18.011466 9789 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:18.011673 9789 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:18.012256 9789 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
W20260811 15:02:18.013070 9089 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
W20260811 15:02:18.013319 9091 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
I20260811 15:02:18.013417 9091 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48; no voters: bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc
I20260811 15:02:18.013574 9789 raft_consensus.cc:2726] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:02:18.313318 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:18.312675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:54733)
0811 15:02:18.313063 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:18.313129 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":104,"threads_started":1}
I20260811 15:02:18.453094 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:18.452625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:60747)
0811 15:02:18.452910 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:18.452985 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":81,"threads_started":1}
I20260811 15:02:18.644677 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:18.644212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:60291)
0811 15:02:18.644489 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:18.644557 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":93,"threads_started":1}
I20260811 15:02:19.314694 9793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:19.314256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:33497)
0811 15:02:19.314523 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:19.314585 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":76,"threads_started":1}
I20260811 15:02:19.454429 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:19.453982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:45261)
0811 15:02:19.454269 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:19.454329 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":84,"threads_started":1}
I20260811 15:02:19.645990 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:19.645555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:57653)
0811 15:02:19.645827 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:19.645888 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
I20260811 15:02:20.316175 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:20.315636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:42205)
0811 15:02:20.315962 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:20.316047 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":83,"threads_started":1}
I20260811 15:02:20.455802 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:20.455327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:46669)
0811 15:02:20.455631 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:20.455697 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":83,"threads_started":1}
I20260811 15:02:20.647330 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:20.646871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:43239)
0811 15:02:20.647171 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:20.647228 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":82,"threads_started":1}
I20260811 15:02:21.317492 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:21.317008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:49747)
0811 15:02:21.317325 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:21.317391 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":86,"threads_started":1}
I20260811 15:02:21.457300 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:21.456743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:49503)
0811 15:02:21.457058 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:21.457123 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":98,"threads_started":1}
I20260811 15:02:21.648635 9809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:21.648171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:43349)
0811 15:02:21.648467 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:21.648529 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":75,"threads_started":1}
I20260811 15:02:22.318876 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:22.318325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:44457)
0811 15:02:22.318711 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:22.318775 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":81,"threads_started":1}
I20260811 15:02:22.458722 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:22.458176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:37125)
0811 15:02:22.458483 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:22.458551 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":93,"threads_started":1}
I20260811 15:02:22.649900 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:22.649468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:44005)
0811 15:02:22.649742 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:22.649799 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":90,"threads_started":1}
I20260811 15:02:23.320415 9817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:23.319972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.65:44499)
0811 15:02:23.320254 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:23.320313 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260811 15:02:23.361076 9818 raft_consensus.cc:482] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:23.361274 9818 raft_consensus.cc:504] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bea41e57c8484692937ebec4e93370d1" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 33519 } } peers { permanent_uuid: "c371e6d60baa44bf922eada3c1caa3cc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35203 } } peers { permanent_uuid: "4b2839d49fce43509f00c2754be3ad48" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 35533 } }
I20260811 15:02:23.361783 9818 leader_election.cc:288] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519), c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203)
W20260811 15:02:23.362587 9091 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bea41e57c8484692937ebec4e93370d1 (127.11.225.67:33519): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
W20260811 15:02:23.362737 9089 leader_election.cc:341] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c371e6d60baa44bf922eada3c1caa3cc (127.11.225.66:35203): Not found: Tablet not found: 602455e4840c422f9d5eef2d72587b54
I20260811 15:02:23.362823 9089 leader_election.cc:302] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b2839d49fce43509f00c2754be3ad48; no voters: bea41e57c8484692937ebec4e93370d1, c371e6d60baa44bf922eada3c1caa3cc
I20260811 15:02:23.362964 9818 raft_consensus.cc:2726] T 602455e4840c422f9d5eef2d72587b54 P 4b2839d49fce43509f00c2754be3ad48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:02:23.460157 9819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:23.459689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.66:56561)
0811 15:02:23.459950 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:23.460005 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":89,"threads_started":1}
I20260811 15:02:23.632293 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 9003
I20260811 15:02:23.650619 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 9289
I20260811 15:02:23.657485 9821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:23.650959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:32859 (local address 127.11.225.67:37595)
0811 15:02:23.657237 (+ 6278us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:23.657326 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.126:32859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6132,"thread_start_us":75,"threads_started":1}
I20260811 15:02:23.663219 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 9515
2026-08-11T15:02:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59746 ms)
[----------] 30 tests from SecurityITest (254227 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:23 dist-test-slave-8hhm krb5kdc[9825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:23 dist-test-slave-8hhm krb5kdc[9825](info): set up 2 sockets
Aug 11 15:02:23 dist-test-slave-8hhm krb5kdc[9825](info): commencing operation
krb5kdc: starting...
W20260811 15:02:24.961427 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:02:25.094811 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36585
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:36585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:25.208711 9848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:25.208989 9848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:25.209071 9848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:25.213089 9848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:25.213147 9848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:25.213166 9848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:25.213183 9848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:25.213263 9848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:25.218510 9848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:36585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:25.219554 9848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:25.220647 9848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:25.229629 9855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.229707 9848 server_base.cc:1034] running on GCE node
W20260811 15:02:25.229713 9860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.229629 9856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.230557 9848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:25.231673 9848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:25.232897 9848 hybrid_clock.cc:648] HybridClock initialized: now 1786460545232884 us; error 28 us; skew 500 ppm
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:25.235882 9848 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:25.236939 9848 webserver.cc:460] Webserver started at http://127.11.225.126:38565/ using document root <none> and password file <none>
I20260811 15:02:25.237609 9848 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:25.237710 9848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:25.237968 9848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:25.240134 9848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "31d35df4ff924fffb4925563f5a6e8da"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "e010b4468cbb40bb5a291e137c5c9828"
server_key_iv: "2c9c46f147d86462df66c5f9743b8425"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.240739 9848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "31d35df4ff924fffb4925563f5a6e8da"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "e010b4468cbb40bb5a291e137c5c9828"
server_key_iv: "2c9c46f147d86462df66c5f9743b8425"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.244818 9848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:02:25.247898 9869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.249184 9848 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:25.249368 9848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "31d35df4ff924fffb4925563f5a6e8da"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "e010b4468cbb40bb5a291e137c5c9828"
server_key_iv: "2c9c46f147d86462df66c5f9743b8425"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.249493 9848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:25.273988 9848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:25.277000 9848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:25.277292 9848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:25.284826 9848 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:36585
I20260811 15:02:25.284852 9958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:36585 every 8 connection(s)
I20260811 15:02:25.285809 9848 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:25.288664 9959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:25.291558 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 9848
I20260811 15:02:25.291712 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:25.292060 12165 external_mini_cluster.cc:1428] Setting key ca3a9e6ca6916a91700334395676b202
I20260811 15:02:25.295277 9959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: Bootstrap starting.
I20260811 15:02:25.297643 9959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:25.298416 9959 log.cc:824] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:25.300880 9959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: No bootstrap required, opened a new log
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:25.305290 9959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } }
I20260811 15:02:25.305579 9959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:25.305639 9959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d35df4ff924fffb4925563f5a6e8da, State: Initialized, Role: FOLLOWER
I20260811 15:02:25.306169 9959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } }
I20260811 15:02:25.306339 9959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:25.306401 9959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:25.306499 9959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:25.307672 9959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } }
I20260811 15:02:25.308053 9959 leader_election.cc:302] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31d35df4ff924fffb4925563f5a6e8da; no voters:
I20260811 15:02:25.308377 9959 leader_election.cc:288] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:25.308501 9964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:25.308597 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:25.293553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59478 (local address 127.11.225.126:36585)
0811 15:02:25.293979 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:25.293995 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:25.294029 (+ 34us) server_negotiation.cc:407] Connection header received
0811 15:02:25.294691 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:25.294709 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:25.295074 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:25.295413 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:25.296232 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.297333 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.298272 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.298837 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.299022 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:25.302037 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:25.302043 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:25.302060 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:25.302091 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:25.304949 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.305501 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.305507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.305513 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.305682 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.306129 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.306132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.306134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.306709 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:25.306936 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:25.307218 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 15:02:25.307555 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":129,"threads_started":1}
I20260811 15:02:25.308744 9964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [term 1 LEADER]: Becoming Leader. State: Replica: 31d35df4ff924fffb4925563f5a6e8da, State: Running, Role: LEADER
I20260811 15:02:25.309124 9964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } }
I20260811 15:02:25.309702 9959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:25.310415 9965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31d35df4ff924fffb4925563f5a6e8da. Latest consensus state: current_term: 1 leader_uuid: "31d35df4ff924fffb4925563f5a6e8da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } } }
I20260811 15:02:25.310544 9965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:25.311378 9967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31d35df4ff924fffb4925563f5a6e8da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31d35df4ff924fffb4925563f5a6e8da" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36585 } } }
I20260811 15:02:25.311586 9967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:25.314910 9987 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:25.314977 9987 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:25.315060 9978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:25.315773 9978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:25.321623 9978 catalog_manager.cc:1347] Generated new cluster ID: 4a7808fada83444fbc9fcda8dd511af3
I20260811 15:02:25.321753 9978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:25.329524 9978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:25.330626 9978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:25.346343 9978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: Generated new TSK 0
I20260811 15:02:25.347100 9978 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:02:25.380347 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:25.497083 10001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:25.497378 10001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:25.497455 10001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:25.501549 10001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:25.501600 10001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:25.501698 10001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:25.506891 10001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:25.507897 10001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:25.508898 10001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:02:25.519426 10001 server_base.cc:1034] running on GCE node
W20260811 15:02:25.519441 10009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.519459 10010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.519481 10012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.519997 10001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:25.520602 10001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:25.521796 10001 hybrid_clock.cc:648] HybridClock initialized: now 1786460545521768 us; error 38 us; skew 500 ppm
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:25.524614 10001 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:02:25.525490 10001 webserver.cc:460] Webserver started at http://127.11.225.65:33823/ using document root <none> and password file <none>
I20260811 15:02:25.525991 10001 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:25.526057 10001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:25.526233 10001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:25.528203 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "0d50754b062e40d2ae99b2bb07d3f51a"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "f1d11a012f88503926ce3c3a2e83410d"
server_key_iv: "65cf8dc379a768289933886a8474275d"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.528671 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "0d50754b062e40d2ae99b2bb07d3f51a"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "f1d11a012f88503926ce3c3a2e83410d"
server_key_iv: "65cf8dc379a768289933886a8474275d"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.532370 10001 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:02:25.534870 10022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.536075 10001 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:25.536206 10001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "0d50754b062e40d2ae99b2bb07d3f51a"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "f1d11a012f88503926ce3c3a2e83410d"
server_key_iv: "65cf8dc379a768289933886a8474275d"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.536314 10001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:25.551407 10001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:25.554837 10001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:25.555068 10001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:25.555696 10001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:25.556547 10001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:25.556596 10001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.556666 10001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:25.556699 10001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.566617 10001 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:43597
I20260811 15:02:25.566648 10215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:43597 every 8 connection(s)
I20260811 15:02:25.567595 10001 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:25.577637 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 10001
I20260811 15:02:25.577788 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:25.578155 12165 external_mini_cluster.cc:1428] Setting key dbfb302b05a27a130ce4161004a96b27
I20260811 15:02:25.581894 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:25.569439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:45163 (local address 127.11.225.126:36585)
0811 15:02:25.569593 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:25.569597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:25.570493 (+ 896us) server_negotiation.cc:407] Connection header received
0811 15:02:25.571778 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:25.571781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:25.571832 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:25.571910 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:25.573096 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.573708 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.574803 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.575016 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.575103 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:25.577615 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:25.577619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:25.577623 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:25.577658 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:25.579353 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.579981 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.579985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.579986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.580093 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.580467 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.580473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.580477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.580762 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:25.580885 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:25.581502 (+ 617us) server_negotiation.cc:299] Negotiation successful
0811 15:02:25.581651 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:02:25.583091 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:25.569808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36585 (local address 127.11.225.65:45163)
0811 15:02:25.570320 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:25.570365 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:25.571569 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:25.572107 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:25.572113 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:25.572452 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:25.572947 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:25.572960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.573822 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.573824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:25.574700 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:25.574709 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.575157 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.575160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:25.575293 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:25.575856 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:25.575872 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:25.577428 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:25.579481 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:25.579487 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:25.579499 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:25.579873 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:25.580205 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:25.580207 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:25.580209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:25.580364 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:25.580895 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:25.580901 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:25.581178 (+ 277us) client_negotiation.cc:769] Sending connection context
0811 15:02:25.581430 (+ 252us) client_negotiation.cc:240] Negotiation successful
0811 15:02:25.581711 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":143,"threads_started":1}
I20260811 15:02:25.584379 10218 heartbeater.cc:347] Connected to a master server at 127.11.225.126:36585
I20260811 15:02:25.584637 10218 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:25.585176 10218 heartbeater.cc:511] Master 127.11.225.126:36585 requested a full tablet report, sending...
I20260811 15:02:25.586877 9897 ts_manager.cc:194] Registered new tserver with Master: 0d50754b062e40d2ae99b2bb07d3f51a (127.11.225.65:43597)
I20260811 15:02:25.588014 9897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:45163
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:02:25.608444 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:25.722222 10224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:25.722451 10224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:25.722491 10224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:25.726485 10224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:25.726538 10224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:25.726603 10224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:25.731681 10224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:25.732645 10224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:25.733621 10224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:25.743611 10232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.743671 10233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.743737 10224 server_base.cc:1034] running on GCE node
W20260811 15:02:25.743659 10238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.744274 10224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:25.745018 10224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:25.746187 10224 hybrid_clock.cc:648] HybridClock initialized: now 1786460545746145 us; error 64 us; skew 500 ppm
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:25.749337 10224 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:02:25.750314 10224 webserver.cc:460] Webserver started at http://127.11.225.66:38857/ using document root <none> and password file <none>
I20260811 15:02:25.750952 10224 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:25.751055 10224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:25.751313 10224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:25.753542 10224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "7574c86b499c49cb975499f313e92722"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d7ac852b6975f4c3caca94a39347b647"
server_key_iv: "2654a7095400ebfb59fadecf7c6167c7"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.754163 10224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "7574c86b499c49cb975499f313e92722"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d7ac852b6975f4c3caca94a39347b647"
server_key_iv: "2654a7095400ebfb59fadecf7c6167c7"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.758225 10224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:25.760612 10247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.761894 10224 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:02:25.762068 10224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "7574c86b499c49cb975499f313e92722"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d7ac852b6975f4c3caca94a39347b647"
server_key_iv: "2654a7095400ebfb59fadecf7c6167c7"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.762202 10224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:25.782073 10224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:25.785597 10224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:25.785797 10224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:25.786386 10224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:25.787243 10224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:25.787317 10224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.787385 10224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:25.787437 10224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.797091 10224 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:40091
I20260811 15:02:25.797137 10438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:40091 every 8 connection(s)
I20260811 15:02:25.798081 10224 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:25.805640 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 10224
I20260811 15:02:25.805787 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:25.806123 12165 external_mini_cluster.cc:1428] Setting key fd86af01435fdee9e0e0be89b96d9c6d
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:25.812960 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:25.799901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:54859 (local address 127.11.225.126:36585)
0811 15:02:25.800032 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:25.800036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:25.800843 (+ 807us) server_negotiation.cc:407] Connection header received
0811 15:02:25.802295 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:25.802298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:25.802355 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:25.802444 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:25.803563 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.804090 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.805255 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.805476 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.805590 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:25.808659 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:25.808662 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:25.808664 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:25.808686 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:25.810526 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.811067 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.811072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.811077 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.811174 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:25.811608 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:25.811614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:25.811618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:25.811888 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:25.811996 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:25.812576 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 15:02:25.812716 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:02:25.813705 10441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:25.800214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36585 (local address 127.11.225.66:54859)
0811 15:02:25.800687 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:25.800730 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:25.802071 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:25.802627 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:25.802633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:25.802965 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:25.803421 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:25.803434 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.804238 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.804246 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:25.805104 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:25.805115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:25.805632 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:25.805636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:25.805862 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:25.806523 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:25.806555 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:25.808497 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:25.810675 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:25.810687 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:25.810700 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:25.810947 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:25.811287 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:25.811293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:25.811294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:25.811493 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:25.812031 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:25.812037 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:25.812335 (+ 298us) client_negotiation.cc:769] Sending connection context
0811 15:02:25.812502 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 15:02:25.812747 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":119,"threads_started":1}
I20260811 15:02:25.814803 10439 heartbeater.cc:347] Connected to a master server at 127.11.225.126:36585
I20260811 15:02:25.815081 10439 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:25.815718 10439 heartbeater.cc:511] Master 127.11.225.126:36585 requested a full tablet report, sending...
I20260811 15:02:25.816872 9897 ts_manager.cc:194] Registered new tserver with Master: 7574c86b499c49cb975499f313e92722 (127.11.225.66:40091)
I20260811 15:02:25.817518 9897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:54859
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:02:25.836741 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:46299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:25.950331 10446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:25.950626 10446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:25.950700 10446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:25.954697 10446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:25.954746 10446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:25.954840 10446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:25.959972 10446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:46299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:36585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:25.960947 10446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:25.961954 10446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:25.971921 10456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.971930 10459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:25.971930 10454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:25.972559 10446 server_base.cc:1034] running on GCE node
I20260811 15:02:25.973033 10446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:25.973770 10446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:25.974972 10446 hybrid_clock.cc:648] HybridClock initialized: now 1786460545974961 us; error 31 us; skew 500 ppm
Aug 11 15:02:25 dist-test-slave-8hhm krb5kdc[9825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:25.977932 10446 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:02:25.978926 10446 webserver.cc:460] Webserver started at http://127.11.225.67:35163/ using document root <none> and password file <none>
I20260811 15:02:25.979549 10446 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:25.979646 10446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:25.979900 10446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:25.982519 10446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "832b0f3f7b4445ca8019f72d66cfd020"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d0d70186fb4081a73e2d520b38cb8df8"
server_key_iv: "afd1b82d44a67c3cd22458bb40d0fbd8"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.983143 10446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "832b0f3f7b4445ca8019f72d66cfd020"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d0d70186fb4081a73e2d520b38cb8df8"
server_key_iv: "afd1b82d44a67c3cd22458bb40d0fbd8"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.987326 10446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:25.989945 10470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:25.991302 10446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:02:25.991467 10446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "832b0f3f7b4445ca8019f72d66cfd020"
format_stamp: "Formatted at 2026-08-11 15:02:25 on dist-test-slave-8hhm"
server_key: "d0d70186fb4081a73e2d520b38cb8df8"
server_key_iv: "afd1b82d44a67c3cd22458bb40d0fbd8"
server_key_version: "encryptionkey@0"
I20260811 15:02:25.991595 10446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:26.001425 10446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:26.004166 10446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:26.004376 10446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:26.004968 10446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:26.005824 10446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:26.005893 10446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.005964 10446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:26.006006 10446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.015576 10446 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:37597
I20260811 15:02:26.015604 10655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:37597 every 8 connection(s)
I20260811 15:02:26.016439 10446 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:26.023200 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 10446
I20260811 15:02:26.023345 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:26.023658 12165 external_mini_cluster.cc:1428] Setting key fafd2bacd16aab8d1407782112e1a7d2
Aug 11 15:02:26 dist-test-slave-8hhm krb5kdc[9825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:26.030241 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.018255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:46131 (local address 127.11.225.126:36585)
0811 15:02:26.018411 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.018416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.019743 (+ 1327us) server_negotiation.cc:407] Connection header received
0811 15:02:26.020595 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.020598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.020647 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.020722 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:26.021977 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.022501 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.023789 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.024074 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.024181 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.026833 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:26.026836 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:26.026838 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:26.026862 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:26.028226 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:26.028697 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:26.028700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:26.028701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:26.028778 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:26.029079 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:26.029081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:26.029083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:26.029336 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:26.029417 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.029937 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.030076 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 15:02:26.031015 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.018688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36585 (local address 127.11.225.67:46131)
0811 15:02:26.019582 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.019626 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.020403 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.020887 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.020894 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.021351 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:26.021845 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.021859 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.022618 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.022620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.023641 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.023651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.024282 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.024287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.024508 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.025133 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:26.025149 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:26.026688 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:26.028330 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:26.028335 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:26.028346 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:26.028608 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:26.028859 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:26.028861 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:26.028863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:26.028992 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:26.029429 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:26.029434 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:26.029686 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.029874 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.030183 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":556,"threads_started":1}
I20260811 15:02:26.032114 10658 heartbeater.cc:347] Connected to a master server at 127.11.225.126:36585
I20260811 15:02:26.032330 10658 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:26.032756 10658 heartbeater.cc:511] Master 127.11.225.126:36585 requested a full tablet report, sending...
I20260811 15:02:26.033794 9897 ts_manager.cc:194] Registered new tserver with Master: 832b0f3f7b4445ca8019f72d66cfd020 (127.11.225.67:37597)
I20260811 15:02:26.034343 9897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:46131
I20260811 15:02:26.037776 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:26.047181 9962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.039801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59492 (local address 127.11.225.126:36585)
0811 15:02:26.039917 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.039922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.040147 (+ 225us) server_negotiation.cc:407] Connection header received
0811 15:02:26.040265 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.040267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.040306 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.040372 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:26.041099 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.041669 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.042467 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.042672 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.042748 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.044052 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:26.044055 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:26.044057 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:26.044096 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:26.045629 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:26.046062 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:26.046069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:26.046072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:26.046186 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:26.046438 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:26.046440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:26.046442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:26.046647 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:26.046758 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.046958 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.047051 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:02:26.049944 9897 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:26.053066 9897 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:26.067742 10675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.061522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43597 (local address 127.0.0.1:60318)
0811 15:02:26.062023 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.062075 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.062219 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.063504 (+ 1285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.063510 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.063535 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:26.063673 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.063680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.064830 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.064833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.066065 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.066074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067193 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.067304 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067345 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.067466 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.067599 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":84,"threads_started":1}
I20260811 15:02:26.067787 10678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.062163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60318 (local address 127.11.225.65:43597)
0811 15:02:26.063090 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.063105 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.063125 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:02:26.063190 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.063194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.063337 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.063489 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:26.063797 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.064693 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.066197 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067061 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067178 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067328 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.067515 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.067635 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":827,"thread_start_us":103,"threads_started":1}
I20260811 15:02:26.068254 10677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.062282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:37597 (local address 127.0.0.1:40960)
0811 15:02:26.062755 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.062769 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.062866 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.063676 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.063678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.063694 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:26.063813 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.063820 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.065199 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.065202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.066450 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.066461 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067803 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.067927 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067952 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.068035 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.068130 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":108,"threads_started":1}
I20260811 15:02:26.068399 10683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.062336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57730 (local address 127.11.225.66:40091)
0811 15:02:26.062978 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.062992 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.063016 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:02:26.063106 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.063112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.063323 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.063489 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:26.064193 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.065303 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.066794 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067531 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067641 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067780 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.068147 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.068251 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":114,"threads_started":1}
I20260811 15:02:26.068832 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.062678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40960 (local address 127.11.225.67:37597)
0811 15:02:26.063110 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.063119 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.063138 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:02:26.063200 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.063204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.063347 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.063526 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:26.063932 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.065043 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.066578 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067502 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067605 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067733 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.068083 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.068174 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":125,"threads_started":1}
I20260811 15:02:26.069100 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.061620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:40091 (local address 127.0.0.1:57730)
0811 15:02:26.062544 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.062558 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.062646 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.063938 (+ 1292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.063941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.063957 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:26.064048 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.064053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.065442 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.065446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.066656 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.066668 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.067853 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.067859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.067974 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.067996 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.068061 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.068857 (+ 796us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":717,"thread_start_us":90,"threads_started":1}
I20260811 15:02:26.071345 10334 tablet_service.cc:1467] Processing CreateTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 (DEFAULT_TABLE table=test-table [id=f03a1ebbe27c44e987a000493b4518e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:26.071359 10099 tablet_service.cc:1467] Processing CreateTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 (DEFAULT_TABLE table=test-table [id=f03a1ebbe27c44e987a000493b4518e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:26.071593 10551 tablet_service.cc:1467] Processing CreateTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 (DEFAULT_TABLE table=test-table [id=f03a1ebbe27c44e987a000493b4518e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:26.072479 10099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1049f1b8d4d4027b8a0bd4786fafdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:26.072479 10551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1049f1b8d4d4027b8a0bd4786fafdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:26.072479 10334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1049f1b8d4d4027b8a0bd4786fafdd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:26.078538 10686 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Bootstrap starting.
I20260811 15:02:26.079856 10688 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Bootstrap starting.
I20260811 15:02:26.080261 10696 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: Bootstrap starting.
I20260811 15:02:26.080881 10686 tablet_bootstrap.cc:654] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:26.082325 10686 log.cc:824] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:26.082654 10688 tablet_bootstrap.cc:654] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:26.084614 10686 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: No bootstrap required, opened a new log
I20260811 15:02:26.084748 10688 log.cc:824] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:26.084854 10686 ts_tablet_manager.cc:1397] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:02:26.084993 10696 tablet_bootstrap.cc:654] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:26.085798 10696 log.cc:824] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:26.086758 10688 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: No bootstrap required, opened a new log
I20260811 15:02:26.086944 10688 ts_tablet_manager.cc:1397] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 15:02:26.087433 10696 tablet_bootstrap.cc:492] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: No bootstrap required, opened a new log
I20260811 15:02:26.087626 10696 ts_tablet_manager.cc:1397] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20260811 15:02:26.088824 10686 raft_consensus.cc:348] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.089095 10686 raft_consensus.cc:374] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:26.089183 10686 raft_consensus.cc:729] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7574c86b499c49cb975499f313e92722, State: Initialized, Role: FOLLOWER
I20260811 15:02:26.089679 10686 consensus_queue.cc:260] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.090785 10686 ts_tablet_manager.cc:1428] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:02:26.090822 10439 heartbeater.cc:503] Master 127.11.225.126:36585 was elected leader, sending a full tablet report...
I20260811 15:02:26.091068 10688 raft_consensus.cc:348] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.091312 10688 raft_consensus.cc:374] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:26.091370 10688 raft_consensus.cc:729] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832b0f3f7b4445ca8019f72d66cfd020, State: Initialized, Role: FOLLOWER
I20260811 15:02:26.091434 10696 raft_consensus.cc:348] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.091671 10696 raft_consensus.cc:374] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:26.091738 10696 raft_consensus.cc:729] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d50754b062e40d2ae99b2bb07d3f51a, State: Initialized, Role: FOLLOWER
I20260811 15:02:26.091816 10688 consensus_queue.cc:260] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.092199 10696 consensus_queue.cc:260] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.092451 10658 heartbeater.cc:503] Master 127.11.225.126:36585 was elected leader, sending a full tablet report...
I20260811 15:02:26.092770 10688 ts_tablet_manager.cc:1428] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:02:26.093173 10696 ts_tablet_manager.cc:1428] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260811 15:02:26.093524 10218 heartbeater.cc:503] Master 127.11.225.126:36585 was elected leader, sending a full tablet report...
I20260811 15:02:26.097169 10703 raft_consensus.cc:482] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:26.097348 10703 raft_consensus.cc:504] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.098374 10703 leader_election.cc:288] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d50754b062e40d2ae99b2bb07d3f51a (127.11.225.65:43597), 7574c86b499c49cb975499f313e92722 (127.11.225.66:40091)
I20260811 15:02:26.103469 10683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.098994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:55381 (local address 127.11.225.66:40091)
0811 15:02:26.099093 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.099097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.099112 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:02:26.099272 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.099274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.099311 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.099371 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:26.099672 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.100374 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102131 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.102726 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102845 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.102895 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.103263 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.103367 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 15:02:26.103469 10678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.098805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:50599 (local address 127.11.225.65:43597)
0811 15:02:26.098926 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.098932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.098948 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:02:26.098993 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.098999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.099047 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.099135 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:26.099485 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.100303 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102143 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.102726 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102845 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.102894 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.103263 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.103349 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:02:26.103502 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.098544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43597 (local address 127.11.225.67:50599)
0811 15:02:26.098641 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.098659 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.098742 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.099196 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.099201 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.099221 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:26.099337 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.099342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.100412 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.100414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.102003 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.102014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.102847 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.103108 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.103154 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.103231 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.103346 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":246}
I20260811 15:02:26.103516 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.098585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:40091 (local address 127.11.225.67:55381)
0811 15:02:26.098930 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.098943 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.099143 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.099402 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.099406 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.099428 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:26.099567 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.099572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.100468 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.100471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.102003 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.102014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.102847 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.102850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.103103 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.103161 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.103231 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.103346 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":236,"thread_start_us":129,"threads_started":1}
I20260811 15:02:26.104105 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1049f1b8d4d4027b8a0bd4786fafdd3" candidate_uuid: "832b0f3f7b4445ca8019f72d66cfd020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" is_pre_election: true
I20260811 15:02:26.104214 10361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1049f1b8d4d4027b8a0bd4786fafdd3" candidate_uuid: "832b0f3f7b4445ca8019f72d66cfd020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7574c86b499c49cb975499f313e92722" is_pre_election: true
I20260811 15:02:26.104404 10132 raft_consensus.cc:2454] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832b0f3f7b4445ca8019f72d66cfd020 in term 0.
I20260811 15:02:26.104544 10361 raft_consensus.cc:2454] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832b0f3f7b4445ca8019f72d66cfd020 in term 0.
I20260811 15:02:26.104964 10472 leader_election.cc:302] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d50754b062e40d2ae99b2bb07d3f51a, 7574c86b499c49cb975499f313e92722, 832b0f3f7b4445ca8019f72d66cfd020; no voters:
I20260811 15:02:26.105257 10703 raft_consensus.cc:2781] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:26.105342 10703 raft_consensus.cc:482] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:26.105393 10703 raft_consensus.cc:3037] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:26.106487 10703 raft_consensus.cc:504] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.106828 10703 leader_election.cc:288] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [CANDIDATE]: Term 1 election: Requested vote from peers 0d50754b062e40d2ae99b2bb07d3f51a (127.11.225.65:43597), 7574c86b499c49cb975499f313e92722 (127.11.225.66:40091)
I20260811 15:02:26.107191 10132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1049f1b8d4d4027b8a0bd4786fafdd3" candidate_uuid: "832b0f3f7b4445ca8019f72d66cfd020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d50754b062e40d2ae99b2bb07d3f51a"
I20260811 15:02:26.107209 10361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1049f1b8d4d4027b8a0bd4786fafdd3" candidate_uuid: "832b0f3f7b4445ca8019f72d66cfd020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7574c86b499c49cb975499f313e92722"
I20260811 15:02:26.107303 10132 raft_consensus.cc:3037] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:26.107339 10361 raft_consensus.cc:3037] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:26.108357 10361 raft_consensus.cc:2454] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832b0f3f7b4445ca8019f72d66cfd020 in term 1.
I20260811 15:02:26.108668 10132 raft_consensus.cc:2454] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832b0f3f7b4445ca8019f72d66cfd020 in term 1.
I20260811 15:02:26.108733 10473 leader_election.cc:302] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7574c86b499c49cb975499f313e92722, 832b0f3f7b4445ca8019f72d66cfd020; no voters:
I20260811 15:02:26.108932 10703 raft_consensus.cc:2781] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:26.109210 10703 raft_consensus.cc:686] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 1 LEADER]: Becoming Leader. State: Replica: 832b0f3f7b4445ca8019f72d66cfd020, State: Running, Role: LEADER
I20260811 15:02:26.109611 10703 consensus_queue.cc:237] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } }
I20260811 15:02:26.112937 9900 catalog_manager.cc:5495] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 832b0f3f7b4445ca8019f72d66cfd020 (127.11.225.67). New cstate: current_term: 1 leader_uuid: "832b0f3f7b4445ca8019f72d66cfd020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "832b0f3f7b4445ca8019f72d66cfd020" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 37597 } health_report { overall_health: HEALTHY } } }
I20260811 15:02:26.130244 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.126552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40972 (local address 127.11.225.67:37597)
0811 15:02:26.126709 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.126714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.126729 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:02:26.126915 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.126917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.126972 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.127083 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:26.127365 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.127882 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.128765 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.128991 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.129096 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.129444 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:26.129852 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:26.129988 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.130027 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.130082 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:02:26.136395 10132 raft_consensus.cc:1261] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 0d50754b062e40d2ae99b2bb07d3f51a [term 1 FOLLOWER]: Refusing update from remote peer 832b0f3f7b4445ca8019f72d66cfd020: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:26.136395 10361 raft_consensus.cc:1261] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 1 FOLLOWER]: Refusing update from remote peer 832b0f3f7b4445ca8019f72d66cfd020: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:26.137182 10706 consensus_queue.cc:1035] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7574c86b499c49cb975499f313e92722" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 40091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:26.137437 10703 consensus_queue.cc:1035] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d50754b062e40d2ae99b2bb07d3f51a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:26.147037 10710 mvcc.cc:205] Tried to move back new op lower bound from 7317342396967563264 to 7317342396867526656. Current Snapshot: MvccSnapshot[applied={T|T < 7317342396967563264}]
I20260811 15:02:26.154825 9897 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:26.154987 9897 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:26.157553 9897 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31d35df4ff924fffb4925563f5a6e8da: Sending DeleteTablet for 3 replicas of tablet c1049f1b8d4d4027b8a0bd4786fafdd3
I20260811 15:02:26.158448 10334 tablet_service.cc:1514] Processing DeleteTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:57730
I20260811 15:02:26.158496 10099 tablet_service.cc:1514] Processing DeleteTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:60318
I20260811 15:02:26.159016 10724 tablet_replica.cc:330] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: stopping tablet replica
I20260811 15:02:26.159027 10551 tablet_service.cc:1514] Processing DeleteTablet for tablet c1049f1b8d4d4027b8a0bd4786fafdd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:26 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:40960
I20260811 15:02:26.159389 10724 raft_consensus.cc:2229] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:26.159487 10727 tablet_replica.cc:330] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: stopping tablet replica
I20260811 15:02:26.159754 10724 raft_consensus.cc:2258] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:26.159777 10727 raft_consensus.cc:2229] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:02:26.159919 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 10001
I20260811 15:02:26.160180 10727 raft_consensus.cc:2258] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:26.164268 10727 ts_tablet_manager.cc:1905] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:26.167449 10727 ts_tablet_manager.cc:1918] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:26.167547 10727 log.cc:1196] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/c1049f1b8d4d4027b8a0bd4786fafdd3
I20260811 15:02:26.167884 10727 ts_tablet_manager.cc:1939] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 832b0f3f7b4445ca8019f72d66cfd020: Deleting consensus metadata
I20260811 15:02:26.169166 9874 catalog_manager.cc:4841] TS 832b0f3f7b4445ca8019f72d66cfd020 (127.11.225.67:37597): tablet c1049f1b8d4d4027b8a0bd4786fafdd3 (table test-table [id=f03a1ebbe27c44e987a000493b4518e7]) successfully deleted
I20260811 15:02:26.174608 10724 ts_tablet_manager.cc:1905] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:26.177548 10724 ts_tablet_manager.cc:1918] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:26.177732 10724 log.cc:1196] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/c1049f1b8d4d4027b8a0bd4786fafdd3
I20260811 15:02:26.178155 10724 ts_tablet_manager.cc:1939] T c1049f1b8d4d4027b8a0bd4786fafdd3 P 7574c86b499c49cb975499f313e92722: Deleting consensus metadata
I20260811 15:02:26.178184 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 10224
W20260811 15:02:26.178146 9873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:43597 (error 108)
I20260811 15:02:26.188293 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.187846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43597 (local address 127.0.0.1:60322)
0811 15:02:26.188075 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.188173 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:43597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260811 15:02:26.188484 9873 catalog_manager.cc:4584] TS 0d50754b062e40d2ae99b2bb07d3f51a (127.11.225.65:43597): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1049f1b8d4d4027b8a0bd4786fafdd3: Network error: Client connection negotiation failed: client connection to 127.11.225.65:43597: connect: Connection refused (error 111)
I20260811 15:02:26.195446 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 10446
I20260811 15:02:26.195607 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.195307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:40091 (local address 127.0.0.1:57736)
0811 15:02:26.195447 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.195508 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.66:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 15:02:26.205526 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 9848
2026-08-11T15:02:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2546 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T15:02:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:26Z Disabled control of system clock
I20260811 15:02:26.247661 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46053
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:46053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:26.361465 10734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:26.361742 10734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:26.361778 10734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:26.365832 10734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:26.365888 10734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:26.365903 10734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:26.365921 10734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:26.365936 10734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:26.370568 10734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:46053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:46053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:26.371598 10734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:26.373044 10734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:26.381940 10743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:26.381901 10750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:26.381943 10746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:26.382196 10734 server_base.cc:1034] running on GCE node
I20260811 15:02:26.382819 10734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:26.383878 10734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:26.385064 10734 hybrid_clock.cc:648] HybridClock initialized: now 1786460546385036 us; error 43 us; skew 500 ppm
I20260811 15:02:26.387002 10734 webserver.cc:460] Webserver started at http://127.11.225.126:37737/ using document root <none> and password file <none>
I20260811 15:02:26.387579 10734 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:26.387679 10734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:26.387909 10734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:26.390029 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "a94deef781c9479e919dd9f31f586ed5"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "73c8b5494f7556273064d649f5a17ed0"
server_key_iv: "a3186c3fd1582359817483244126878c"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.390609 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "a94deef781c9479e919dd9f31f586ed5"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "73c8b5494f7556273064d649f5a17ed0"
server_key_iv: "a3186c3fd1582359817483244126878c"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.394150 10734 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 15:02:26.396392 10757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.397660 10734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:26.397799 10734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "a94deef781c9479e919dd9f31f586ed5"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "73c8b5494f7556273064d649f5a17ed0"
server_key_iv: "a3186c3fd1582359817483244126878c"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.397922 10734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:26.408723 10734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:26.409415 10734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:26.409606 10734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:26.416625 10853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:46053 every 8 connection(s)
I20260811 15:02:26.416621 10734 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:46053
I20260811 15:02:26.417646 10734 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:26.420671 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:26.423683 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 10734
I20260811 15:02:26.423817 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:26.424126 12165 external_mini_cluster.cc:1428] Setting key 59e29f63655f7c0d1a4efc63df8b54fa
I20260811 15:02:26.426770 10854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: Bootstrap starting.
I20260811 15:02:26.428930 10854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:26.429736 10854 log.cc:824] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:26.431914 10854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: No bootstrap required, opened a new log
I20260811 15:02:26.433967 10858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.425660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.11.225.126:46053)
0811 15:02:26.426294 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.426309 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.426344 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:02:26.427027 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.427047 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.427446 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.427791 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:26.428237 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.429273 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.430269 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.430882 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.431055 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.431884 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:26.431890 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:26.431905 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:26.432401 (+ 496us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:26.432469 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:26.432507 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:26.432601 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.432758 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.433012 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":141,"threads_started":1}
I20260811 15:02:26.435925 10854 raft_consensus.cc:348] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } }
I20260811 15:02:26.436139 10854 raft_consensus.cc:374] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:26.436172 10854 raft_consensus.cc:729] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a94deef781c9479e919dd9f31f586ed5, State: Initialized, Role: FOLLOWER
I20260811 15:02:26.436585 10854 consensus_queue.cc:260] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } }
I20260811 15:02:26.436709 10854 raft_consensus.cc:388] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:26.436755 10854 raft_consensus.cc:482] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:26.436826 10854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:26.437698 10854 raft_consensus.cc:504] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } }
I20260811 15:02:26.437989 10854 leader_election.cc:302] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a94deef781c9479e919dd9f31f586ed5; no voters:
I20260811 15:02:26.438227 10854 leader_election.cc:288] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:26.438365 10863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:26.438597 10863 raft_consensus.cc:686] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [term 1 LEADER]: Becoming Leader. State: Replica: a94deef781c9479e919dd9f31f586ed5, State: Running, Role: LEADER
I20260811 15:02:26.438896 10863 consensus_queue.cc:237] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } }
I20260811 15:02:26.439477 10854 sys_catalog.cc:564] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:26.440538 10865 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a94deef781c9479e919dd9f31f586ed5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } } }
I20260811 15:02:26.440675 10865 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:26.440989 10868 sys_catalog.cc:455] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a94deef781c9479e919dd9f31f586ed5. Latest consensus state: current_term: 1 leader_uuid: "a94deef781c9479e919dd9f31f586ed5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a94deef781c9479e919dd9f31f586ed5" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 46053 } } }
I20260811 15:02:26.441092 10868 sys_catalog.cc:458] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:26.441166 10877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:26.444614 10877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:26.450248 10877 catalog_manager.cc:1347] Generated new cluster ID: 2fd263f5128147968c6fdcf221588132
I20260811 15:02:26.450316 10877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:26.462316 10877 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:26.463160 10877 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:26.467733 10877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: Generated new TSK 0
I20260811 15:02:26.468438 10877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:26.474964 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--builtin_ntp_servers=127.11.225.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:26.591082 10893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:26.591364 10893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:26.591445 10893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:26.595352 10893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:26.595423 10893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:26.595510 10893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:26.600180 10893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:26.601253 10893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:26.602661 10893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:26.612377 10902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:26.612363 10904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:26.612447 10893 server_base.cc:1034] running on GCE node
W20260811 15:02:26.612380 10901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:26.612984 10893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:26.613677 10893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:26.614878 10893 hybrid_clock.cc:648] HybridClock initialized: now 1786460546614841 us; error 48 us; skew 500 ppm
I20260811 15:02:26.616801 10893 webserver.cc:460] Webserver started at http://127.11.225.65:33949/ using document root <none> and password file <none>
I20260811 15:02:26.617445 10893 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:26.617547 10893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:26.617791 10893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:26.619755 10893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "b5cbf0d1a30245f783243bbfcd80611f"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "50c90ed0a691fbfba66218f97a93bc2f"
server_key_iv: "6edd7e96c1dc3fbde7194d05930ba9aa"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.620319 10893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "b5cbf0d1a30245f783243bbfcd80611f"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "50c90ed0a691fbfba66218f97a93bc2f"
server_key_iv: "6edd7e96c1dc3fbde7194d05930ba9aa"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.623859 10893 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 15:02:26.626307 10914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.627504 10893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:26.627651 10893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "b5cbf0d1a30245f783243bbfcd80611f"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "50c90ed0a691fbfba66218f97a93bc2f"
server_key_iv: "6edd7e96c1dc3fbde7194d05930ba9aa"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.627766 10893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:26.655128 10893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:26.655829 10893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:26.656038 10893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:26.656647 10893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:26.657629 10893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:26.657701 10893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.657773 10893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:26.657824 10893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.666903 10893 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:41257
I20260811 15:02:26.666944 11123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:41257 every 8 connection(s)
I20260811 15:02:26.667790 10893 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:26.672668 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 10893
I20260811 15:02:26.672812 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:26.673112 12165 external_mini_cluster.cc:1428] Setting key 7ae324fa8cbbd1d18c4832d350b99605
I20260811 15:02:26.675114 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--builtin_ntp_servers=127.11.225.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:26.677515 10858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.669626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:35877 (local address 127.11.225.126:46053)
0811 15:02:26.669766 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.669771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.670773 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 15:02:26.672235 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.672238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.672306 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.672441 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:26.673447 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.674083 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.675394 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.675628 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.675742 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.676918 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:26.676924 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:26.676926 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:26.676944 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:26.676964 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:26.676972 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:26.677099 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.677309 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.677370 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:02:26.678360 11126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.669996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46053 (local address 127.11.225.65:35877)
0811 15:02:26.670628 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.670669 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.672011 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.672615 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.672621 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.672699 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:26.673310 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.673326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.674220 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.674223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.675213 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.675249 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.675784 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.675788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.675946 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.676643 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:26.676645 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:26.676685 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:26.676746 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:26.677100 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:26.677113 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:26.677122 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.677302 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.677596 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":111,"threads_started":1}
I20260811 15:02:26.679641 11124 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46053
I20260811 15:02:26.679893 11124 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:26.680478 11124 heartbeater.cc:511] Master 127.11.225.126:46053 requested a full tablet report, sending...
I20260811 15:02:26.682286 10785 ts_manager.cc:194] Registered new tserver with Master: b5cbf0d1a30245f783243bbfcd80611f (127.11.225.65:41257)
I20260811 15:02:26.684208 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.65:35877
W20260811 15:02:26.792021 11127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:26.792268 11127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:26.792304 11127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:26.796221 11127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:26.796272 11127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:26.796324 11127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:26.800827 11127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:26.801956 11127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:26.803335 11127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:26.812844 11137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:26.812943 11135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:26.812851 11132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:26.813045 11127 server_base.cc:1034] running on GCE node
I20260811 15:02:26.813467 11127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:26.814079 11127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:26.815272 11127 hybrid_clock.cc:648] HybridClock initialized: now 1786460546815241 us; error 45 us; skew 500 ppm
I20260811 15:02:26.817204 11127 webserver.cc:460] Webserver started at http://127.11.225.66:43935/ using document root <none> and password file <none>
I20260811 15:02:26.817839 11127 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:26.817935 11127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:26.818154 11127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:26.820165 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "47cf03ebebab4a4facc40f1cee5a91c1"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "6a6b4c5820d9ad263a1274ca1e78cbb0"
server_key_iv: "8199858327285c95b98f4f67d2198b1b"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.820746 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "47cf03ebebab4a4facc40f1cee5a91c1"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "6a6b4c5820d9ad263a1274ca1e78cbb0"
server_key_iv: "8199858327285c95b98f4f67d2198b1b"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.824371 11127 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.001s
I20260811 15:02:26.826838 11146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.828030 11127 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:26.828169 11127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "47cf03ebebab4a4facc40f1cee5a91c1"
format_stamp: "Formatted at 2026-08-11 15:02:26 on dist-test-slave-8hhm"
server_key: "6a6b4c5820d9ad263a1274ca1e78cbb0"
server_key_iv: "8199858327285c95b98f4f67d2198b1b"
server_key_version: "encryptionkey@0"
I20260811 15:02:26.828277 11127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:26.841917 11127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:26.842542 11127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:26.842751 11127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:26.843325 11127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:26.844266 11127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:26.844349 11127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.844421 11127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:26.844468 11127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:26.854032 11127 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:37381
I20260811 15:02:26.854063 11341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:37381 every 8 connection(s)
I20260811 15:02:26.854945 11127 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:26.863370 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 11127
I20260811 15:02:26.863503 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:26.863826 12165 external_mini_cluster.cc:1428] Setting key 404166720af3870c10385ee03452e19a
I20260811 15:02:26.864576 10858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.856794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:59611 (local address 127.11.225.126:46053)
0811 15:02:26.856932 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:26.856936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:26.858066 (+ 1130us) server_negotiation.cc:407] Connection header received
0811 15:02:26.859562 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:26.859565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:26.859627 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:26.859736 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:26.860674 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.861226 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.862377 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.862619 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.862728 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.864015 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:26.864019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:26.864022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:26.864036 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:26.864059 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:26.864071 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:26.864176 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:26.864356 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 15:02:26.864412 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:02:26.865651 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:26.857201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46053 (local address 127.11.225.66:59611)
0811 15:02:26.857907 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:26.857947 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:26.859328 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:26.859944 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:26.859951 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:26.860041 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:26.860519 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.860531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.861363 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.861372 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.862244 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:26.862254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:26.862783 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:26.862787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:26.862987 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:26.863702 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:26.863704 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:26.863744 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:26.863809 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:26.864176 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:26.864184 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:26.864189 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:02:26.864335 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 15:02:26.864607 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":111,"threads_started":1}
I20260811 15:02:26.866153 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--builtin_ntp_servers=127.11.225.84:39975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:26.866881 11342 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46053
I20260811 15:02:26.867130 11342 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:26.867688 11342 heartbeater.cc:511] Master 127.11.225.126:46053 requested a full tablet report, sending...
I20260811 15:02:26.868786 10785 ts_manager.cc:194] Registered new tserver with Master: 47cf03ebebab4a4facc40f1cee5a91c1 (127.11.225.66:37381)
I20260811 15:02:26.869431 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.66:59611
W20260811 15:02:26.986871 11345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:26.987108 11345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:26.987144 11345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:26.991220 11345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:26.991269 11345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:26.991318 11345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:26.996061 11345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:39975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:46053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:26.997133 11345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:26.998538 11345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:27.008427 11351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:27.008483 11353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:27.008481 11357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:27.008937 11345 server_base.cc:1034] running on GCE node
I20260811 15:02:27.009661 11345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:27.010274 11345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:27.011475 11345 hybrid_clock.cc:648] HybridClock initialized: now 1786460547011438 us; error 49 us; skew 500 ppm
I20260811 15:02:27.013372 11345 webserver.cc:460] Webserver started at http://127.11.225.67:33829/ using document root <none> and password file <none>
I20260811 15:02:27.013958 11345 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:27.014050 11345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:27.014287 11345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:27.016280 11345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "b6c85f1e038c4ff8bce0d047df30af37"
format_stamp: "Formatted at 2026-08-11 15:02:27 on dist-test-slave-8hhm"
server_key: "219b4ed273c6e56a7e91b9e2be58d9e4"
server_key_iv: "d11e6e105cd01af7cb15944e4e5add5d"
server_key_version: "encryptionkey@0"
I20260811 15:02:27.016846 11345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "b6c85f1e038c4ff8bce0d047df30af37"
format_stamp: "Formatted at 2026-08-11 15:02:27 on dist-test-slave-8hhm"
server_key: "219b4ed273c6e56a7e91b9e2be58d9e4"
server_key_iv: "d11e6e105cd01af7cb15944e4e5add5d"
server_key_version: "encryptionkey@0"
I20260811 15:02:27.020478 11345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260811 15:02:27.022891 11370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:27.024022 11345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:27.024158 11345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "b6c85f1e038c4ff8bce0d047df30af37"
format_stamp: "Formatted at 2026-08-11 15:02:27 on dist-test-slave-8hhm"
server_key: "219b4ed273c6e56a7e91b9e2be58d9e4"
server_key_iv: "d11e6e105cd01af7cb15944e4e5add5d"
server_key_version: "encryptionkey@0"
I20260811 15:02:27.024268 11345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:27.049083 11345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:27.049801 11345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:27.050004 11345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:27.050621 11345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:27.051635 11345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:27.051729 11345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:27.051812 11345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:27.051867 11345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:27.060891 11345 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:43221
I20260811 15:02:27.060930 11562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:43221 every 8 connection(s)
I20260811 15:02:27.061843 11345 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:27.064283 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 11345
I20260811 15:02:27.064369 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:27.064656 12165 external_mini_cluster.cc:1428] Setting key 0bb164f859eccf4054bb93c89472f3ce
I20260811 15:02:27.071610 10858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.063703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:40901 (local address 127.11.225.126:46053)
0811 15:02:27.063889 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.063894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.065153 (+ 1259us) server_negotiation.cc:407] Connection header received
0811 15:02:27.066923 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.066926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.066982 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.067083 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:27.067988 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.068481 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.069809 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.070067 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.070168 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.071204 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:27.071207 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:27.071209 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:27.071221 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:27.071239 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:27.071247 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:27.071314 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.071452 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.071503 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:02:27.072470 11567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.064195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:46053 (local address 127.11.225.67:40901)
0811 15:02:27.064961 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.065014 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.066661 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.067277 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.067283 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.067366 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:27.067853 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.067865 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.068599 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.068602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.069549 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.069559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.070216 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.070219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.070357 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.070939 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:27.070941 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:27.070980 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:27.071041 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:27.071328 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:27.071335 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:27.071339 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.071427 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.071632 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":188,"threads_started":1}
I20260811 15:02:27.073599 11563 heartbeater.cc:347] Connected to a master server at 127.11.225.126:46053
I20260811 15:02:27.073800 11563 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:27.074299 11563 heartbeater.cc:511] Master 127.11.225.126:46053 requested a full tablet report, sending...
I20260811 15:02:27.075289 10785 ts_manager.cc:194] Registered new tserver with Master: b6c85f1e038c4ff8bce0d047df30af37 (127.11.225.67:43221)
I20260811 15:02:27.075793 10785 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.67:40901
I20260811 15:02:27.078680 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:27.084481 10858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.080578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48888 (local address 127.11.225.126:46053)
0811 15:02:27.080696 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.080699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.080868 (+ 169us) server_negotiation.cc:407] Connection header received
0811 15:02:27.080960 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.080962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.081000 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.081063 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:27.081319 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.081804 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.082568 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.082760 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.082839 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.083954 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:27.083962 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:27.083964 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:27.083976 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:27.083992 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:27.084000 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:27.084123 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.084279 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.084341 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:02:27.088120 10785 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:27.091158 10785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:27.105921 11583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.100205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41257 (local address 127.0.0.1:42536)
0811 15:02:27.100688 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.100705 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.100805 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.101768 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.101774 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.101795 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:27.101915 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.101922 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.103446 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.103450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.104532 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.104542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105375 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.105379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.105489 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.105526 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.105631 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.105749 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":78,"thread_start_us":112,"threads_started":1}
I20260811 15:02:27.105927 11587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.100673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.11.225.65:41257)
0811 15:02:27.101287 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.101304 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.101328 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:02:27.101406 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.101413 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.101610 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.102117 (+ 507us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:27.102254 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.103312 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.104676 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105201 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.105378 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.105576 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.105668 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.105759 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":156,"threads_started":1}
I20260811 15:02:27.105971 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.099820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:43221 (local address 127.0.0.1:47850)
0811 15:02:27.100219 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.100288 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.100415 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.101589 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.101595 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.101618 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:27.101771 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.101779 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.102969 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.102975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.104433 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.104440 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105531 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.105534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.105652 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.105674 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.105737 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.105807 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":57,"thread_start_us":113,"threads_started":1}
I20260811 15:02:27.106561 11585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.100598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:37381 (local address 127.0.0.1:43524)
0811 15:02:27.100881 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.100895 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.100995 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.101794 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.101797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.101809 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:27.102005 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.102015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.103381 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.103384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.104562 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.104570 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105531 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.105534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.106283 (+ 749us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.106303 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.106364 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.106430 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":799,"spinlock_wait_cycles":768,"thread_start_us":118,"threads_started":1}
I20260811 15:02:27.106825 11590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.101050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43524 (local address 127.11.225.66:37381)
0811 15:02:27.101367 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.101380 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.101398 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:02:27.101462 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.101465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.101662 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.101921 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:27.102096 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.103254 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.104678 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105418 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.105596 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.105886 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.106464 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.106556 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":110,"threads_started":1}
I20260811 15:02:27.107288 11580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.100047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.11.225.67:43221)
0811 15:02:27.101068 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.101080 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.101105 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:02:27.101187 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.101192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.101416 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.101932 (+ 516us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:27.102096 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.102862 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.104574 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.105373 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.106749 (+ 1376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.106967 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.107019 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.107112 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":109,"threads_started":1}
I20260811 15:02:27.109066 11000 tablet_service.cc:1467] Processing CreateTablet for tablet afd633be0269426ab1d55ab86b7ff8cc (DEFAULT_TABLE table=test-table [id=774f700857ed41a69954faf118513e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:27.109524 11227 tablet_service.cc:1467] Processing CreateTablet for tablet afd633be0269426ab1d55ab86b7ff8cc (DEFAULT_TABLE table=test-table [id=774f700857ed41a69954faf118513e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:27.110374 11000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd633be0269426ab1d55ab86b7ff8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:27.109987 11454 tablet_service.cc:1467] Processing CreateTablet for tablet afd633be0269426ab1d55ab86b7ff8cc (DEFAULT_TABLE table=test-table [id=774f700857ed41a69954faf118513e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:27.110709 11227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd633be0269426ab1d55ab86b7ff8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:27.110960 11454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd633be0269426ab1d55ab86b7ff8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:27.117444 11596 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Bootstrap starting.
I20260811 15:02:27.118331 11598 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Bootstrap starting.
I20260811 15:02:27.119534 11596 tablet_bootstrap.cc:654] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:27.120060 11598 tablet_bootstrap.cc:654] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:27.120277 11596 log.cc:824] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:27.120869 11599 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Bootstrap starting.
I20260811 15:02:27.120857 11598 log.cc:824] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:27.122602 11598 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: No bootstrap required, opened a new log
I20260811 15:02:27.122798 11598 ts_tablet_manager.cc:1397] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 15:02:27.123917 11599 tablet_bootstrap.cc:654] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:27.124563 11599 log.cc:824] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:27.125458 11596 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: No bootstrap required, opened a new log
I20260811 15:02:27.125662 11596 ts_tablet_manager.cc:1397] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260811 15:02:27.126273 11598 raft_consensus.cc:348] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.126503 11598 raft_consensus.cc:374] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:27.126562 11598 raft_consensus.cc:729] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cbf0d1a30245f783243bbfcd80611f, State: Initialized, Role: FOLLOWER
I20260811 15:02:27.127048 11598 consensus_queue.cc:260] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.127701 11124 heartbeater.cc:503] Master 127.11.225.126:46053 was elected leader, sending a full tablet report...
I20260811 15:02:27.128124 11598 ts_tablet_manager.cc:1428] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260811 15:02:27.130379 11599 tablet_bootstrap.cc:492] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: No bootstrap required, opened a new log
I20260811 15:02:27.130580 11599 ts_tablet_manager.cc:1397] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260811 15:02:27.131155 11596 raft_consensus.cc:348] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.131397 11596 raft_consensus.cc:374] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:27.131467 11596 raft_consensus.cc:729] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47cf03ebebab4a4facc40f1cee5a91c1, State: Initialized, Role: FOLLOWER
I20260811 15:02:27.131927 11596 consensus_queue.cc:260] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.132688 11342 heartbeater.cc:503] Master 127.11.225.126:46053 was elected leader, sending a full tablet report...
I20260811 15:02:27.132896 11596 ts_tablet_manager.cc:1428] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:02:27.134903 11599 raft_consensus.cc:348] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.135186 11599 raft_consensus.cc:374] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:27.135253 11599 raft_consensus.cc:729] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c85f1e038c4ff8bce0d047df30af37, State: Initialized, Role: FOLLOWER
I20260811 15:02:27.135677 11599 consensus_queue.cc:260] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.136317 11563 heartbeater.cc:503] Master 127.11.225.126:46053 was elected leader, sending a full tablet report...
I20260811 15:02:27.136603 11599 ts_tablet_manager.cc:1428] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:02:27.153546 11605 raft_consensus.cc:482] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:27.153712 11605 raft_consensus.cc:504] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.154790 11605 leader_election.cc:288] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6c85f1e038c4ff8bce0d047df30af37 (127.11.225.67:43221), b5cbf0d1a30245f783243bbfcd80611f (127.11.225.65:41257)
I20260811 15:02:27.158272 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.154963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:43221 (local address 127.11.225.66:45251)
0811 15:02:27.155083 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.155102 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.155188 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.155464 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.155467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.155485 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:27.155607 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.155613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.156344 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.156349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.157166 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.157175 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.157859 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.157863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.157960 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.157996 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.158082 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.158146 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":18}
I20260811 15:02:27.158272 11580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.155059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:45251 (local address 127.11.225.67:43221)
0811 15:02:27.155186 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.155194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.155212 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:02:27.155268 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.155271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.155321 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.155444 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:27.155724 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.156233 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.157338 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.157735 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.157866 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.157916 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.158097 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.158157 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:02:27.158913 11607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.155058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41257 (local address 127.11.225.66:55581)
0811 15:02:27.155461 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.155471 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:27.155597 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:27.155862 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:27.155864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:27.155881 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:27.156014 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.156019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.156734 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.156737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.157629 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:27.157638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.158269 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.158273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:27.158569 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.158593 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:02:27.158685 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 15:02:27.158775 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":19,"thread_start_us":126,"threads_started":1}
I20260811 15:02:27.158937 11587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.155252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:55581 (local address 127.11.225.65:41257)
0811 15:02:27.155397 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.155401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.155568 (+ 167us) server_negotiation.cc:407] Connection header received
0811 15:02:27.155710 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.155713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.155767 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.155848 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:27.156128 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.156613 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.157750 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.158151 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.158272 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.158333 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.158756 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.158829 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:02:27.159041 11491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afd633be0269426ab1d55ab86b7ff8cc" candidate_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6c85f1e038c4ff8bce0d047df30af37" is_pre_election: true
I20260811 15:02:27.159361 11491 raft_consensus.cc:2454] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47cf03ebebab4a4facc40f1cee5a91c1 in term 0.
I20260811 15:02:27.159605 11032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afd633be0269426ab1d55ab86b7ff8cc" candidate_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cbf0d1a30245f783243bbfcd80611f" is_pre_election: true
I20260811 15:02:27.159860 11032 raft_consensus.cc:2454] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47cf03ebebab4a4facc40f1cee5a91c1 in term 0.
I20260811 15:02:27.159874 11151 leader_election.cc:302] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47cf03ebebab4a4facc40f1cee5a91c1, b6c85f1e038c4ff8bce0d047df30af37; no voters:
I20260811 15:02:27.160140 11605 raft_consensus.cc:2781] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:27.160224 11605 raft_consensus.cc:482] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:27.160292 11605 raft_consensus.cc:3037] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:27.161484 11605 raft_consensus.cc:504] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.161852 11605 leader_election.cc:288] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [CANDIDATE]: Term 1 election: Requested vote from peers b6c85f1e038c4ff8bce0d047df30af37 (127.11.225.67:43221), b5cbf0d1a30245f783243bbfcd80611f (127.11.225.65:41257)
I20260811 15:02:27.162154 11491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afd633be0269426ab1d55ab86b7ff8cc" candidate_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6c85f1e038c4ff8bce0d047df30af37"
I20260811 15:02:27.162295 11491 raft_consensus.cc:3037] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:27.162340 11032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afd633be0269426ab1d55ab86b7ff8cc" candidate_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cbf0d1a30245f783243bbfcd80611f"
I20260811 15:02:27.162528 11032 raft_consensus.cc:3037] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:27.163419 11491 raft_consensus.cc:2454] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47cf03ebebab4a4facc40f1cee5a91c1 in term 1.
I20260811 15:02:27.163512 11032 raft_consensus.cc:2454] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47cf03ebebab4a4facc40f1cee5a91c1 in term 1.
I20260811 15:02:27.163722 11151 leader_election.cc:302] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47cf03ebebab4a4facc40f1cee5a91c1, b6c85f1e038c4ff8bce0d047df30af37; no voters:
I20260811 15:02:27.163898 11605 raft_consensus.cc:2781] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:27.164132 11605 raft_consensus.cc:686] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 1 LEADER]: Becoming Leader. State: Replica: 47cf03ebebab4a4facc40f1cee5a91c1, State: Running, Role: LEADER
I20260811 15:02:27.164486 11605 consensus_queue.cc:237] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } }
I20260811 15:02:27.167512 10785 catalog_manager.cc:5495] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47cf03ebebab4a4facc40f1cee5a91c1 (127.11.225.66). New cstate: current_term: 1 leader_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47cf03ebebab4a4facc40f1cee5a91c1" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 37381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 } health_report { overall_health: UNKNOWN } } }
W20260811 15:02:27.169006 11125 tablet.cc:2369] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:02:27.184685 11590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.181102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43530 (local address 127.11.225.66:37381)
0811 15:02:27.181274 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:27.181279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:27.181293 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:02:27.181417 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:27.181420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:27.181473 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:27.181591 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:27.181838 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.182333 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.183213 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:27.183419 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:27.183525 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:27.183886 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:27.184278 (+ 392us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:27.184401 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:27.184474 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 15:02:27.184524 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:02:27.190965 11491 raft_consensus.cc:1261] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 1 FOLLOWER]: Refusing update from remote peer 47cf03ebebab4a4facc40f1cee5a91c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:27.190999 11032 raft_consensus.cc:1261] T afd633be0269426ab1d55ab86b7ff8cc P b5cbf0d1a30245f783243bbfcd80611f [term 1 FOLLOWER]: Refusing update from remote peer 47cf03ebebab4a4facc40f1cee5a91c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:27.191687 11611 consensus_queue.cc:1035] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6c85f1e038c4ff8bce0d047df30af37" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:27.191923 11605 consensus_queue.cc:1035] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5cbf0d1a30245f783243bbfcd80611f" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:27.199251 11619 mvcc.cc:205] Tried to move back new op lower bound from 7317342401286402048 to 7317342401188171776. Current Snapshot: MvccSnapshot[applied={T|T < 7317342401286402048}]
I20260811 15:02:27.199404 11615 mvcc.cc:205] Tried to move back new op lower bound from 7317342401286402048 to 7317342401188171776. Current Snapshot: MvccSnapshot[applied={T|T < 7317342401286402048}]
I20260811 15:02:27.208822 10779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:27.209044 10779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:27.211632 10779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a94deef781c9479e919dd9f31f586ed5: Sending DeleteTablet for 3 replicas of tablet afd633be0269426ab1d55ab86b7ff8cc
I20260811 15:02:27.212476 11227 tablet_service.cc:1514] Processing DeleteTablet for tablet afd633be0269426ab1d55ab86b7ff8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:27 UTC) from {username='slave'} at 127.0.0.1:43524
I20260811 15:02:27.212476 11000 tablet_service.cc:1514] Processing DeleteTablet for tablet afd633be0269426ab1d55ab86b7ff8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:27 UTC) from {username='slave'} at 127.0.0.1:42536
I20260811 15:02:27.212699 11454 tablet_service.cc:1514] Processing DeleteTablet for tablet afd633be0269426ab1d55ab86b7ff8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260811 15:02:27.213231 11635 tablet_replica.cc:330] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: stopping tablet replica
I20260811 15:02:27.213254 11634 tablet_replica.cc:330] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: stopping tablet replica
I20260811 15:02:27.213363 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 10893
I20260811 15:02:27.213609 11634 raft_consensus.cc:2229] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:02:27.213999 11634 raft_consensus.cc:2258] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:27.214366 11635 raft_consensus.cc:2229] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:27.214891 11635 raft_consensus.cc:2258] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:27.220578 11635 ts_tablet_manager.cc:1905] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:27.221096 11634 ts_tablet_manager.cc:1905] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:27.223953 11634 ts_tablet_manager.cc:1918] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:27.224052 11634 log.cc:1196] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/afd633be0269426ab1d55ab86b7ff8cc
I20260811 15:02:27.224363 11634 ts_tablet_manager.cc:1939] T afd633be0269426ab1d55ab86b7ff8cc P 47cf03ebebab4a4facc40f1cee5a91c1: Deleting consensus metadata
I20260811 15:02:27.224511 11635 ts_tablet_manager.cc:1918] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:27.224658 11635 log.cc:1196] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/afd633be0269426ab1d55ab86b7ff8cc
I20260811 15:02:27.225025 11635 ts_tablet_manager.cc:1939] T afd633be0269426ab1d55ab86b7ff8cc P b6c85f1e038c4ff8bce0d047df30af37: Deleting consensus metadata
I20260811 15:02:27.225564 10761 catalog_manager.cc:4841] TS 47cf03ebebab4a4facc40f1cee5a91c1 (127.11.225.66:37381): tablet afd633be0269426ab1d55ab86b7ff8cc (table test-table [id=774f700857ed41a69954faf118513e13]) successfully deleted
I20260811 15:02:27.226397 10761 catalog_manager.cc:4841] TS b6c85f1e038c4ff8bce0d047df30af37 (127.11.225.67:43221): tablet afd633be0269426ab1d55ab86b7ff8cc (table test-table [id=774f700857ed41a69954faf118513e13]) successfully deleted
W20260811 15:02:27.228504 10762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:41257 (error 108)
I20260811 15:02:27.228690 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 11127
I20260811 15:02:27.234629 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:27.234127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:41257 (local address 127.0.0.1:42548)
0811 15:02:27.234368 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:27.234487 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:41257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260811 15:02:27.234970 10762 catalog_manager.cc:4584] TS b5cbf0d1a30245f783243bbfcd80611f (127.11.225.65:41257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet afd633be0269426ab1d55ab86b7ff8cc: Network error: Client connection negotiation failed: client connection to 127.11.225.65:41257: connect: Connection refused (error 111)
I20260811 15:02:27.249755 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 11345
I20260811 15:02:27.260615 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 10734
2026-08-11T15:02:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1053 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:27 dist-test-slave-8hhm krb5kdc[11643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:27 dist-test-slave-8hhm krb5kdc[11643](info): set up 2 sockets
Aug 11 15:02:27 dist-test-slave-8hhm krb5kdc[11643](info): commencing operation
krb5kdc: starting...
W20260811 15:02:28.562582 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:28 dist-test-slave-8hhm krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:02:28.693086 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45641
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:28.808715 11659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:28.808974 11659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:28.809012 11659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:28.812896 11659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:28.812949 11659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:28.812975 11659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:28.812991 11659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:28.813006 11659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:28.818133 11659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:28.819087 11659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:28.820019 11659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:28.828735 11666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:28.828718 11659 server_base.cc:1034] running on GCE node
W20260811 15:02:28.828701 11667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:28.828716 11669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:28.829627 11659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:28.830718 11659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:28.831885 11659 hybrid_clock.cc:648] HybridClock initialized: now 1786460548831864 us; error 29 us; skew 500 ppm
Aug 11 15:02:28 dist-test-slave-8hhm krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:28.840159 11659 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:28.841056 11659 webserver.cc:460] Webserver started at http://127.11.225.126:34755/ using document root <none> and password file <none>
I20260811 15:02:28.841681 11659 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:28.841770 11659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:28.842027 11659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:28.844041 11659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "bbc0cb106f0b4cee986b4f5c93803061"
format_stamp: "Formatted at 2026-08-11 15:02:28 on dist-test-slave-8hhm"
server_key: "d2833ebc375e0fc15e85bb5e515db85a"
server_key_iv: "12a150bc2506599949b244d44e0135f2"
server_key_version: "encryptionkey@0"
I20260811 15:02:28.844609 11659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "bbc0cb106f0b4cee986b4f5c93803061"
format_stamp: "Formatted at 2026-08-11 15:02:28 on dist-test-slave-8hhm"
server_key: "d2833ebc375e0fc15e85bb5e515db85a"
server_key_iv: "12a150bc2506599949b244d44e0135f2"
server_key_version: "encryptionkey@0"
I20260811 15:02:28.848492 11659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:02:28.851003 11681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:28.852372 11659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:28.852525 11659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "bbc0cb106f0b4cee986b4f5c93803061"
format_stamp: "Formatted at 2026-08-11 15:02:28 on dist-test-slave-8hhm"
server_key: "d2833ebc375e0fc15e85bb5e515db85a"
server_key_iv: "12a150bc2506599949b244d44e0135f2"
server_key_version: "encryptionkey@0"
I20260811 15:02:28.852648 11659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:28.863658 11659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:28.866878 11659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:28.867095 11659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:28.874300 11659 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45641
I20260811 15:02:28.874313 11763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45641 every 8 connection(s)
I20260811 15:02:28.875280 11659 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:28.878119 11765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:28.880285 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 11659
I20260811 15:02:28.880455 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:28.880844 12165 external_mini_cluster.cc:1428] Setting key f8a914961d7425eb74af91747b779270
I20260811 15:02:28.884413 11765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: Bootstrap starting.
I20260811 15:02:28.887295 11765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:28.888322 11765 log.cc:824] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:28.890779 11765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: No bootstrap required, opened a new log
Aug 11 15:02:28 dist-test-slave-8hhm krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:28.895340 11765 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } }
I20260811 15:02:28.895653 11765 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:28.895725 11765 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbc0cb106f0b4cee986b4f5c93803061, State: Initialized, Role: FOLLOWER
I20260811 15:02:28.896235 11765 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } }
I20260811 15:02:28.896395 11765 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:28.896464 11765 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:28.896584 11765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:28.897707 11765 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } }
I20260811 15:02:28.898072 11765 leader_election.cc:302] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbc0cb106f0b4cee986b4f5c93803061; no voters:
I20260811 15:02:28.898458 11765 leader_election.cc:288] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:28.898576 11776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:28.898841 11776 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [term 1 LEADER]: Becoming Leader. State: Replica: bbc0cb106f0b4cee986b4f5c93803061, State: Running, Role: LEADER
I20260811 15:02:28.899235 11776 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } }
I20260811 15:02:28.899789 11765 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:28.900447 11776 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbc0cb106f0b4cee986b4f5c93803061. Latest consensus state: current_term: 1 leader_uuid: "bbc0cb106f0b4cee986b4f5c93803061" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } } }
I20260811 15:02:28.900565 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:28.882562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60252 (local address 127.11.225.126:45641)
0811 15:02:28.884755 (+ 2193us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:28.884774 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:28.884817 (+ 43us) server_negotiation.cc:407] Connection header received
0811 15:02:28.885709 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:28.885737 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:28.886162 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:28.886522 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:28.887776 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:28.889424 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:28.890663 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:28.891352 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:28.891513 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:28.894487 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:28.894496 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:28.894515 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:28.894548 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:28.896755 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:28.897283 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:28.897289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:28.897295 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:28.897447 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:28.897735 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:28.897739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:28.897741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:28.898304 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:28.898500 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:28.899287 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 15:02:28.899590 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2034,"thread_start_us":137,"threads_started":1}
I20260811 15:02:28.901279 11776 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:28.901121 11777 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbc0cb106f0b4cee986b4f5c93803061" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc0cb106f0b4cee986b4f5c93803061" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45641 } } }
I20260811 15:02:28.901487 11777 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:28.902103 11787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:28.905624 11787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:28.911087 11787 catalog_manager.cc:1347] Generated new cluster ID: 34b6e7ae95d14ccf936a3ca84734435a
I20260811 15:02:28.911202 11787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:28.932195 11787 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:28.933154 11787 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:28.937199 11787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: Generated new TSK 0
I20260811 15:02:28.937933 11787 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:02:28.968489 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:29.082139 11806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:29.082448 11806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:29.082494 11806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:29.086439 11806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:29.086493 11806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:29.086587 11806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:29.092314 11806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:29.093817 11806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:29.095248 11806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:29.105368 11816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:29.105368 11818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:29.105417 11814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:29.105628 11806 server_base.cc:1034] running on GCE node
I20260811 15:02:29.106096 11806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:29.106796 11806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:29.107980 11806 hybrid_clock.cc:648] HybridClock initialized: now 1786460549107961 us; error 28 us; skew 500 ppm
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:29.111255 11806 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:02:29.112236 11806 webserver.cc:460] Webserver started at http://127.11.225.65:44401/ using document root <none> and password file <none>
I20260811 15:02:29.112879 11806 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:29.112962 11806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:29.113202 11806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:29.115633 11806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "fd5c6fc1fc444354ad5826d73f228b78"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "09917e7c72bfccfe9dd9fd8ca5fde54a"
server_key_iv: "3811c52205257b185679eb7223f46072"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.116295 11806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "fd5c6fc1fc444354ad5826d73f228b78"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "09917e7c72bfccfe9dd9fd8ca5fde54a"
server_key_iv: "3811c52205257b185679eb7223f46072"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.120496 11806 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 15:02:29.123242 11827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.124527 11806 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:29.124691 11806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "fd5c6fc1fc444354ad5826d73f228b78"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "09917e7c72bfccfe9dd9fd8ca5fde54a"
server_key_iv: "3811c52205257b185679eb7223f46072"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.124812 11806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:29.138516 11806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:29.141721 11806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:29.141958 11806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:29.142594 11806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:29.143515 11806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:29.143594 11806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.143697 11806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:29.143750 11806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.153795 11806 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:43261
I20260811 15:02:29.153832 12015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:43261 every 8 connection(s)
I20260811 15:02:29.154803 11806 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:29.156085 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 11806
I20260811 15:02:29.156243 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:29.156659 12165 external_mini_cluster.cc:1428] Setting key 23bb54565895e6d4b7f3d7a68fd7cf60
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 15:02:29.169759 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.156995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:46975 (local address 127.11.225.126:45641)
0811 15:02:29.157160 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.157164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.158357 (+ 1193us) server_negotiation.cc:407] Connection header received
0811 15:02:29.159760 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.159763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.159815 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.159894 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:29.161083 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.161701 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.162838 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.163073 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.163185 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.165841 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:29.165845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:29.165847 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:29.165871 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:29.167489 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.168101 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.168105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.168106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.168199 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.168583 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.168586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.168588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.168777 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:29.168890 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.169443 (+ 553us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.169577 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 15:02:29.170588 12020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.157610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45641 (local address 127.11.225.65:46975)
0811 15:02:29.158202 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.158260 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.159552 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.160075 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.160083 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.160442 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:29.160922 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.160935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.161833 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.161836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.162710 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.162720 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.163229 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.163233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.163411 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.164134 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:29.164150 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:29.165665 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:29.167612 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.167618 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.167634 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.167970 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.168292 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.168295 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.168297 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.168441 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.168889 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:29.168897 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:29.169149 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.169387 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.169730 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":164,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 15:02:29.171936 12016 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45641
I20260811 15:02:29.172220 12016 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:29.172884 12016 heartbeater.cc:511] Master 127.11.225.126:45641 requested a full tablet report, sending...
I20260811 15:02:29.174723 11710 ts_manager.cc:194] Registered new tserver with Master: fd5c6fc1fc444354ad5826d73f228b78 (127.11.225.65:43261)
I20260811 15:02:29.176523 11710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:46975
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:02:29.188252 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:29.302359 12025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:29.302611 12025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:29.302654 12025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:29.306677 12025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:29.306730 12025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:29.306787 12025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:29.311898 12025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:29.312829 12025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:29.313786 12025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:29.323490 12044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:29.323485 12038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:29.323523 12036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:29.323832 12025 server_base.cc:1034] running on GCE node
I20260811 15:02:29.324292 12025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:29.324892 12025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:29.326077 12025 hybrid_clock.cc:648] HybridClock initialized: now 1786460549326068 us; error 31 us; skew 500 ppm
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:29.328948 12025 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:02:29.329852 12025 webserver.cc:460] Webserver started at http://127.11.225.66:43325/ using document root <none> and password file <none>
I20260811 15:02:29.330397 12025 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:29.330487 12025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:29.330713 12025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:29.332664 12025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "6f51964b02b34c7a9c966a290b0fda1a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "cfddab9171c54eec06397987137059f2"
server_key_iv: "247062815bb999a69137203315eb6963"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.333309 12025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "6f51964b02b34c7a9c966a290b0fda1a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "cfddab9171c54eec06397987137059f2"
server_key_iv: "247062815bb999a69137203315eb6963"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.337024 12025 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:02:29.339407 12053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.340647 12025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:29.340781 12025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "6f51964b02b34c7a9c966a290b0fda1a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "cfddab9171c54eec06397987137059f2"
server_key_iv: "247062815bb999a69137203315eb6963"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.340890 12025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:29.363550 12025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:29.366627 12025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:29.366820 12025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:29.367405 12025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:29.368224 12025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:29.368273 12025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.368341 12025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:29.368391 12025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.377247 12025 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:39463
I20260811 15:02:29.377295 12245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:39463 every 8 connection(s)
I20260811 15:02:29.378170 12025 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:29.385309 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12025
I20260811 15:02:29.385471 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:29.385792 12165 external_mini_cluster.cc:1428] Setting key e5f781bb5bef64c62c1353ad395a73d8
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:29.392673 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.379970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:49129 (local address 127.11.225.126:45641)
0811 15:02:29.380112 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.380115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.380904 (+ 789us) server_negotiation.cc:407] Connection header received
0811 15:02:29.382336 (+ 1432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.382340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.382399 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.382510 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:29.383667 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.384211 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.385501 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.385867 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.385988 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.388653 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:29.388657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:29.388659 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:29.388682 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:29.390470 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.390972 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.390977 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.390979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.391077 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.391535 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.391538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.391540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.391739 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:29.391823 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.392442 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.392557 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:02:29.393985 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.380331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45641 (local address 127.11.225.66:49129)
0811 15:02:29.380765 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.380806 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.382126 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.382698 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.382705 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.383051 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:29.383521 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.383534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.384340 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.384349 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.385309 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.385318 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.386020 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.386024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.386163 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.386831 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:29.386847 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:29.388487 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:29.390611 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.390616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.390627 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.390872 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.391196 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.391202 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.391207 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.391404 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.391854 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:29.391864 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:29.392183 (+ 319us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.392400 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.392793 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":112,"threads_started":1}
I20260811 15:02:29.395227 12246 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45641
I20260811 15:02:29.395478 12246 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:29.395967 12246 heartbeater.cc:511] Master 127.11.225.126:45641 requested a full tablet report, sending...
I20260811 15:02:29.397025 11710 ts_manager.cc:194] Registered new tserver with Master: 6f51964b02b34c7a9c966a290b0fda1a (127.11.225.66:39463)
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 15:02:29.397707 11710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:49129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:02:29.416828 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:43527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:29.531750 12253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:29.532011 12253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:29.532058 12253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:29.536129 12253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:29.536191 12253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:29.536248 12253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:29.541370 12253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:29.542423 12253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:29.543493 12253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:29.553535 12262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:29.553596 12253 server_base.cc:1034] running on GCE node
W20260811 15:02:29.553804 12264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:29.553544 12266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:29.554414 12253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:29.555032 12253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:29.556236 12253 hybrid_clock.cc:648] HybridClock initialized: now 1786460549556193 us; error 57 us; skew 500 ppm
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:29.559219 12253 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:02:29.560130 12253 webserver.cc:460] Webserver started at http://127.11.225.67:37251/ using document root <none> and password file <none>
I20260811 15:02:29.560711 12253 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:29.560807 12253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:29.561058 12253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:29.563271 12253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "fc6a2af66f9a447dae4cc38eef04cc2a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "88cea695cf2ad6f5c2e7d3c09c255655"
server_key_iv: "326d4ad90c1fefdd20434830081695d5"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.563868 12253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "fc6a2af66f9a447dae4cc38eef04cc2a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "88cea695cf2ad6f5c2e7d3c09c255655"
server_key_iv: "326d4ad90c1fefdd20434830081695d5"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.567667 12253 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:29.570144 12284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.571327 12253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:29.571458 12253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "fc6a2af66f9a447dae4cc38eef04cc2a"
format_stamp: "Formatted at 2026-08-11 15:02:29 on dist-test-slave-8hhm"
server_key: "88cea695cf2ad6f5c2e7d3c09c255655"
server_key_iv: "326d4ad90c1fefdd20434830081695d5"
server_key_version: "encryptionkey@0"
I20260811 15:02:29.571571 12253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:29.612560 12253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:29.615761 12253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:29.615975 12253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:29.616611 12253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:29.617652 12253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:29.617733 12253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.617808 12253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:29.617861 12253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:29.627290 12253 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:46061
I20260811 15:02:29.627318 12462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:46061 every 8 connection(s)
I20260811 15:02:29.628255 12253 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:29.634397 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12253
I20260811 15:02:29.634544 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:29.634873 12165 external_mini_cluster.cc:1428] Setting key a2e48cbfe500fcdfe8cdf9eab60f7c7f
Aug 11 15:02:29 dist-test-slave-8hhm krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:29.641956 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.630172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:40583 (local address 127.11.225.126:45641)
0811 15:02:29.630327 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.630332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.631159 (+ 827us) server_negotiation.cc:407] Connection header received
0811 15:02:29.632448 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.632451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.632499 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.632572 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:29.633697 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.634327 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.635694 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.635989 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.636071 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.638736 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:29.638739 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:29.638741 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:29.638764 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:29.640099 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.640569 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.640572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.640573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.640657 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.640961 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.640963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.640964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.641145 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:29.641267 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.641736 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.641837 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:02:29.642809 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.630558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45641 (local address 127.11.225.67:40583)
0811 15:02:29.631002 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.631046 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.632253 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.632735 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.632742 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.633075 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:29.633569 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.633582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.634457 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.634459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.635578 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.635588 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.636159 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.636162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.636365 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.636994 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:29.637010 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:29.638571 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:29.640213 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.640218 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.640229 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.640478 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.640738 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:29.640740 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:29.640741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:29.640882 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:29.641295 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:29.641300 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:29.641524 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.641684 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.641928 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260811 15:02:29.644099 12463 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45641
I20260811 15:02:29.644332 12463 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:29.644797 12463 heartbeater.cc:511] Master 127.11.225.126:45641 requested a full tablet report, sending...
I20260811 15:02:29.645900 11710 ts_manager.cc:194] Registered new tserver with Master: fc6a2af66f9a447dae4cc38eef04cc2a (127.11.225.67:46061)
I20260811 15:02:29.646445 11710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:40583
I20260811 15:02:29.648861 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:29.659133 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.651000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.11.225.126:45641)
0811 15:02:29.651187 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.651192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.651412 (+ 220us) server_negotiation.cc:407] Connection header received
0811 15:02:29.651487 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.651489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.651531 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.651605 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:29.652323 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.652828 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.653746 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.654065 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.654181 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.655830 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:29.655833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:29.655835 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:29.655860 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:29.657414 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.657903 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.657905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.657907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.657987 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:29.658272 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:29.658275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:29.658276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:29.658489 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:29.658613 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.658839 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.658960 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 15:02:29.661900 11710 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:29.664944 11710 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:29.680039 12488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.673611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.11.225.67:46061)
0811 15:02:29.675589 (+ 1978us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.675601 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.675622 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:02:29.675697 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.675704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.675895 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.676056 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:29.676343 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.677074 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.678674 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.679320 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.679447 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.679615 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.679794 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.679890 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1870,"thread_start_us":181,"threads_started":1}
I20260811 15:02:29.680048 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.673467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:46061 (local address 127.0.0.1:35686)
0811 15:02:29.673791 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.673837 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.674122 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.676039 (+ 1917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.676042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.676062 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:29.676181 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.676187 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.677218 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.677221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.678538 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.678550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.679448 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.679452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.679570 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.679609 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.679760 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.679886 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":74,"thread_start_us":96,"threads_started":1}
I20260811 15:02:29.680294 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.674200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43261 (local address 127.0.0.1:34304)
0811 15:02:29.674901 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.674913 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.675329 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.675819 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.675821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.675839 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:29.675924 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.675930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.677642 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.677648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.678734 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.678747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.679800 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.679804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.679886 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.679912 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.679958 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.680022 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":34,"thread_start_us":109,"threads_started":1}
I20260811 15:02:29.680608 12495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.674376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.11.225.65:43261)
0811 15:02:29.674716 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.674724 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.675013 (+ 289us) server_negotiation.cc:407] Connection header received
0811 15:02:29.675481 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.675487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.675691 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.675840 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:29.676391 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.677533 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.678864 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.679675 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.680120 (+ 445us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.680284 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.680330 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.680449 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":146,"threads_started":1}
I20260811 15:02:29.681502 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.673734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:39463 (local address 127.0.0.1:50144)
0811 15:02:29.674446 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.674461 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.674566 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.675410 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.675418 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.675442 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:29.675599 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.675608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.677127 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.677133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.679447 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.679458 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.681065 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.681069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.681159 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.681179 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.681300 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.681366 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":3,"thread_start_us":85,"threads_started":1}
I20260811 15:02:29.681568 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.674219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50144 (local address 127.11.225.66:39463)
0811 15:02:29.674835 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.674850 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.674870 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:02:29.674935 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.674939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.675275 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.675432 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:29.675732 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.676946 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.679594 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.680936 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.681061 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.681197 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.681332 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.681419 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":124,"threads_started":1}
I20260811 15:02:29.683560 12355 tablet_service.cc:1467] Processing CreateTablet for tablet aa6dba6b2e37415085540cbccdcacbec (DEFAULT_TABLE table=test-table [id=dc7541fbcd894e43b5b6e8f925c89585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:29.683557 11904 tablet_service.cc:1467] Processing CreateTablet for tablet aa6dba6b2e37415085540cbccdcacbec (DEFAULT_TABLE table=test-table [id=dc7541fbcd894e43b5b6e8f925c89585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:29.684034 12135 tablet_service.cc:1467] Processing CreateTablet for tablet aa6dba6b2e37415085540cbccdcacbec (DEFAULT_TABLE table=test-table [id=dc7541fbcd894e43b5b6e8f925c89585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:29.684764 11904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6dba6b2e37415085540cbccdcacbec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:29.684764 12355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6dba6b2e37415085540cbccdcacbec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:29.685036 12135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa6dba6b2e37415085540cbccdcacbec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:29.692437 12496 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Bootstrap starting.
I20260811 15:02:29.692607 12497 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: Bootstrap starting.
I20260811 15:02:29.693008 12499 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Bootstrap starting.
I20260811 15:02:29.694562 12496 tablet_bootstrap.cc:654] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:29.694834 12497 tablet_bootstrap.cc:654] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:29.695005 12499 tablet_bootstrap.cc:654] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:29.695780 12496 log.cc:824] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:29.695883 12497 log.cc:824] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:29.696321 12499 log.cc:824] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:29.697844 12496 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: No bootstrap required, opened a new log
I20260811 15:02:29.697942 12497 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: No bootstrap required, opened a new log
I20260811 15:02:29.698096 12496 ts_tablet_manager.cc:1397] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:02:29.698164 12497 ts_tablet_manager.cc:1397] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:02:29.701090 12496 raft_consensus.cc:348] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.701490 12496 raft_consensus.cc:374] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:29.701550 12496 raft_consensus.cc:729] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f51964b02b34c7a9c966a290b0fda1a, State: Initialized, Role: FOLLOWER
I20260811 15:02:29.701715 12497 raft_consensus.cc:348] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.702051 12497 raft_consensus.cc:374] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:29.702116 12497 raft_consensus.cc:729] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd5c6fc1fc444354ad5826d73f228b78, State: Initialized, Role: FOLLOWER
I20260811 15:02:29.702127 12496 consensus_queue.cc:260] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.702602 12497 consensus_queue.cc:260] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.702847 12246 heartbeater.cc:503] Master 127.11.225.126:45641 was elected leader, sending a full tablet report...
I20260811 15:02:29.703146 12496 ts_tablet_manager.cc:1428] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:02:29.703261 12499 tablet_bootstrap.cc:492] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: No bootstrap required, opened a new log
I20260811 15:02:29.703437 12499 ts_tablet_manager.cc:1397] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260811 15:02:29.703540 12497 ts_tablet_manager.cc:1428] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 15:02:29.703868 12016 heartbeater.cc:503] Master 127.11.225.126:45641 was elected leader, sending a full tablet report...
I20260811 15:02:29.707414 12499 raft_consensus.cc:348] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.707701 12499 raft_consensus.cc:374] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:29.707787 12499 raft_consensus.cc:729] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc6a2af66f9a447dae4cc38eef04cc2a, State: Initialized, Role: FOLLOWER
I20260811 15:02:29.708148 12499 consensus_queue.cc:260] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.708789 12463 heartbeater.cc:503] Master 127.11.225.126:45641 was elected leader, sending a full tablet report...
I20260811 15:02:29.709038 12499 ts_tablet_manager.cc:1428] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:02:29.740411 12503 raft_consensus.cc:482] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:29.740615 12503 raft_consensus.cc:504] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.741740 12503 leader_election.cc:288] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc6a2af66f9a447dae4cc38eef04cc2a (127.11.225.67:46061), fd5c6fc1fc444354ad5826d73f228b78 (127.11.225.65:43261)
I20260811 15:02:29.746048 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.742037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:46061 (local address 127.11.225.66:34715)
0811 15:02:29.742193 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.742210 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.742315 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.742724 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.742727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.742744 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:29.742885 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.742892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.743749 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.743752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.744699 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.744709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.745599 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.745602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.745682 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.745702 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.745765 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.745852 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":58}
I20260811 15:02:29.746047 12488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.742109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:34715 (local address 127.11.225.67:46061)
0811 15:02:29.742256 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.742261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.742277 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:02:29.742426 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.742430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.742486 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.742580 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:29.743030 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.743639 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.744848 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.745469 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.745591 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.745643 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.745823 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.745902 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:02:29.746299 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.742351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43261 (local address 127.11.225.66:46717)
0811 15:02:29.742707 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.742719 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:29.742808 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:29.743058 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:29.743061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:29.743078 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:29.743204 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.743210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.743943 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.743946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.744955 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:29.744965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.745897 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.745900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:29.745989 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.746011 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:02:29.746087 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 15:02:29.746151 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":15,"thread_start_us":159,"threads_started":1}
I20260811 15:02:29.746351 12495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.742474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:46717 (local address 127.11.225.65:43261)
0811 15:02:29.742656 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.742660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.742797 (+ 137us) server_negotiation.cc:407] Connection header received
0811 15:02:29.742882 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.742885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.742944 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.743031 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:29.743314 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.743820 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.745106 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.745763 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.745891 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.745935 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.746125 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.746209 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:02:29.746820 12387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6dba6b2e37415085540cbccdcacbec" candidate_uuid: "6f51964b02b34c7a9c966a290b0fda1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" is_pre_election: true
I20260811 15:02:29.747009 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6dba6b2e37415085540cbccdcacbec" candidate_uuid: "6f51964b02b34c7a9c966a290b0fda1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5c6fc1fc444354ad5826d73f228b78" is_pre_election: true
I20260811 15:02:29.747160 12387 raft_consensus.cc:2454] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f51964b02b34c7a9c966a290b0fda1a in term 0.
I20260811 15:02:29.747336 11941 raft_consensus.cc:2454] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f51964b02b34c7a9c966a290b0fda1a in term 0.
I20260811 15:02:29.747673 12055 leader_election.cc:302] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f51964b02b34c7a9c966a290b0fda1a, fc6a2af66f9a447dae4cc38eef04cc2a; no voters:
I20260811 15:02:29.747920 12503 raft_consensus.cc:2781] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:29.748010 12503 raft_consensus.cc:482] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:29.748064 12503 raft_consensus.cc:3037] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:29.749158 12503 raft_consensus.cc:504] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.749612 12503 leader_election.cc:288] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [CANDIDATE]: Term 1 election: Requested vote from peers fc6a2af66f9a447dae4cc38eef04cc2a (127.11.225.67:46061), fd5c6fc1fc444354ad5826d73f228b78 (127.11.225.65:43261)
I20260811 15:02:29.750061 12387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6dba6b2e37415085540cbccdcacbec" candidate_uuid: "6f51964b02b34c7a9c966a290b0fda1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a"
I20260811 15:02:29.750051 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa6dba6b2e37415085540cbccdcacbec" candidate_uuid: "6f51964b02b34c7a9c966a290b0fda1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5c6fc1fc444354ad5826d73f228b78"
I20260811 15:02:29.750200 12387 raft_consensus.cc:3037] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:29.750217 11941 raft_consensus.cc:3037] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:29.751286 11941 raft_consensus.cc:2454] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f51964b02b34c7a9c966a290b0fda1a in term 1.
I20260811 15:02:29.751307 12387 raft_consensus.cc:2454] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f51964b02b34c7a9c966a290b0fda1a in term 1.
I20260811 15:02:29.751585 12055 leader_election.cc:302] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f51964b02b34c7a9c966a290b0fda1a, fd5c6fc1fc444354ad5826d73f228b78; no voters:
I20260811 15:02:29.751812 12503 raft_consensus.cc:2781] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:29.752084 12503 raft_consensus.cc:686] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 1 LEADER]: Becoming Leader. State: Replica: 6f51964b02b34c7a9c966a290b0fda1a, State: Running, Role: LEADER
I20260811 15:02:29.752441 12503 consensus_queue.cc:237] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } }
I20260811 15:02:29.755942 11710 catalog_manager.cc:5495] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f51964b02b34c7a9c966a290b0fda1a (127.11.225.66). New cstate: current_term: 1 leader_uuid: "6f51964b02b34c7a9c966a290b0fda1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f51964b02b34c7a9c966a290b0fda1a" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39463 } health_report { overall_health: HEALTHY } } }
I20260811 15:02:29.781705 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.777917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50150 (local address 127.11.225.66:39463)
0811 15:02:29.778113 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:29.778117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:29.778134 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:02:29.778214 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:29.778216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:29.778277 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:29.778392 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:29.778613 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.779165 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.780163 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:29.780379 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:29.780468 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:29.780772 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:29.781285 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:29.781427 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:29.781531 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 15:02:29.781574 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 15:02:29.787904 11941 raft_consensus.cc:1261] T aa6dba6b2e37415085540cbccdcacbec P fd5c6fc1fc444354ad5826d73f228b78 [term 1 FOLLOWER]: Refusing update from remote peer 6f51964b02b34c7a9c966a290b0fda1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:29.787902 12387 raft_consensus.cc:1261] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 1 FOLLOWER]: Refusing update from remote peer 6f51964b02b34c7a9c966a290b0fda1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:29.788810 12510 consensus_queue.cc:1035] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc6a2af66f9a447dae4cc38eef04cc2a" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:29.789245 12503 consensus_queue.cc:1035] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd5c6fc1fc444354ad5826d73f228b78" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:29.797263 12516 mvcc.cc:205] Tried to move back new op lower bound from 7317342411922907136 to 7317342411789389824. Current Snapshot: MvccSnapshot[applied={T|T < 7317342411922907136}]
I20260811 15:02:29.798528 12515 mvcc.cc:205] Tried to move back new op lower bound from 7317342411922907136 to 7317342411789389824. Current Snapshot: MvccSnapshot[applied={T|T < 7317342411922907136}]
I20260811 15:02:29.807713 11706 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:29.807874 11706 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:29.810565 11706 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbc0cb106f0b4cee986b4f5c93803061: Sending DeleteTablet for 3 replicas of tablet aa6dba6b2e37415085540cbccdcacbec
I20260811 15:02:29.811544 12135 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6dba6b2e37415085540cbccdcacbec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:29 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:50144
I20260811 15:02:29.811517 12355 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6dba6b2e37415085540cbccdcacbec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:29 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:35686
I20260811 15:02:29.812077 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 11806
I20260811 15:02:29.812107 11904 tablet_service.cc:1514] Processing DeleteTablet for tablet aa6dba6b2e37415085540cbccdcacbec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:29 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:34304
I20260811 15:02:29.812402 12536 tablet_replica.cc:330] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: stopping tablet replica
I20260811 15:02:29.812840 12536 raft_consensus.cc:2229] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:29.813261 12536 raft_consensus.cc:2258] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:29.815450 12534 tablet_replica.cc:330] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: stopping tablet replica
I20260811 15:02:29.815774 12534 raft_consensus.cc:2229] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:02:29.816226 12534 raft_consensus.cc:2258] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:29.819176 12536 ts_tablet_manager.cc:1905] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:29.819449 12534 ts_tablet_manager.cc:1905] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:29.822597 12536 ts_tablet_manager.cc:1918] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:29.822844 12536 log.cc:1196] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/aa6dba6b2e37415085540cbccdcacbec
I20260811 15:02:29.822995 12534 ts_tablet_manager.cc:1918] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:29.823099 12534 log.cc:1196] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/aa6dba6b2e37415085540cbccdcacbec
I20260811 15:02:29.823454 12534 ts_tablet_manager.cc:1939] T aa6dba6b2e37415085540cbccdcacbec P 6f51964b02b34c7a9c966a290b0fda1a: Deleting consensus metadata
I20260811 15:02:29.823704 12536 ts_tablet_manager.cc:1939] T aa6dba6b2e37415085540cbccdcacbec P fc6a2af66f9a447dae4cc38eef04cc2a: Deleting consensus metadata
I20260811 15:02:29.824837 11687 catalog_manager.cc:4841] TS 6f51964b02b34c7a9c966a290b0fda1a (127.11.225.66:39463): tablet aa6dba6b2e37415085540cbccdcacbec (table test-table [id=dc7541fbcd894e43b5b6e8f925c89585]) successfully deleted
I20260811 15:02:29.825129 11684 catalog_manager.cc:4841] TS fc6a2af66f9a447dae4cc38eef04cc2a (127.11.225.67:46061): tablet aa6dba6b2e37415085540cbccdcacbec (table test-table [id=dc7541fbcd894e43b5b6e8f925c89585]) successfully deleted
W20260811 15:02:29.827149 11684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:43261 (error 108)
I20260811 15:02:29.827924 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12025
I20260811 15:02:29.828248 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:29.827937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:43261 (local address 127.0.0.1:34320)
0811 15:02:29.828081 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:29.828151 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:43261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 15:02:29.839461 11684 catalog_manager.cc:4584] TS fd5c6fc1fc444354ad5826d73f228b78 (127.11.225.65:43261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa6dba6b2e37415085540cbccdcacbec: Network error: Client connection negotiation failed: client connection to 127.11.225.65:43261: connect: Connection refused (error 111)
I20260811 15:02:29.846655 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12253
I20260811 15:02:29.863962 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 11659
2026-08-11T15:02:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2602 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T15:02:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:29Z Disabled control of system clock
I20260811 15:02:29.903636 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45789
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:37557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:30.016024 12543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:30.016281 12543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:30.016317 12543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:30.020277 12543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:30.020334 12543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:30.020349 12543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:30.020364 12543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:30.020380 12543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:30.024977 12543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45789
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:30.026049 12543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:30.027352 12543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:30.035821 12549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.035866 12543 server_base.cc:1034] running on GCE node
W20260811 15:02:30.035799 12548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.035938 12553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.036628 12543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:30.037762 12543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:30.038945 12543 hybrid_clock.cc:648] HybridClock initialized: now 1786460550038918 us; error 39 us; skew 500 ppm
I20260811 15:02:30.040900 12543 webserver.cc:460] Webserver started at http://127.11.225.126:35019/ using document root <none> and password file <none>
I20260811 15:02:30.041510 12543 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:30.041589 12543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:30.041762 12543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:30.043725 12543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "baefac94096244e1a5e48f8d48cbaaab"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "4ab7b4dbc92c881323656d8300a9c623"
server_key_iv: "32aad66143a01561b5f1a61422aa37e4"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.044260 12543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "baefac94096244e1a5e48f8d48cbaaab"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "4ab7b4dbc92c881323656d8300a9c623"
server_key_iv: "32aad66143a01561b5f1a61422aa37e4"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.047925 12543 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:02:30.050479 12562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.051904 12543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:02:30.052011 12543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "baefac94096244e1a5e48f8d48cbaaab"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "4ab7b4dbc92c881323656d8300a9c623"
server_key_iv: "32aad66143a01561b5f1a61422aa37e4"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.052135 12543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:30.081701 12543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:30.082469 12543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:30.082638 12543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:30.090166 12543 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45789
I20260811 15:02:30.090180 12653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45789 every 8 connection(s)
I20260811 15:02:30.091135 12543 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:30.094329 12656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:30.099956 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12543
I20260811 15:02:30.100106 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:30.100409 12165 external_mini_cluster.cc:1428] Setting key 609d9ef1e306a239094f47a92a83ec09
I20260811 15:02:30.101513 12656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: Bootstrap starting.
I20260811 15:02:30.103830 12656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:30.104580 12656 log.cc:824] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:30.106459 12656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: No bootstrap required, opened a new log
I20260811 15:02:30.109858 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.101946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44986 (local address 127.11.225.126:45789)
0811 15:02:30.102616 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.102631 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.102667 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:30.103269 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.103285 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.103669 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.104016 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:30.104500 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.105569 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.106474 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.107002 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.107184 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.108096 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:30.108102 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:30.108114 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:30.108484 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:30.108539 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:30.108561 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:30.108667 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.108831 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.109089 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":139,"threads_started":1}
I20260811 15:02:30.110285 12656 raft_consensus.cc:348] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } }
I20260811 15:02:30.110528 12656 raft_consensus.cc:374] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:30.110590 12656 raft_consensus.cc:729] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefac94096244e1a5e48f8d48cbaaab, State: Initialized, Role: FOLLOWER
I20260811 15:02:30.111048 12656 consensus_queue.cc:260] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } }
I20260811 15:02:30.111207 12656 raft_consensus.cc:388] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:30.111284 12656 raft_consensus.cc:482] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:30.111405 12656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:30.112398 12656 raft_consensus.cc:504] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } }
I20260811 15:02:30.112732 12656 leader_election.cc:302] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baefac94096244e1a5e48f8d48cbaaab; no voters:
I20260811 15:02:30.113058 12656 leader_election.cc:288] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:30.113176 12663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:30.113451 12663 raft_consensus.cc:686] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [term 1 LEADER]: Becoming Leader. State: Replica: baefac94096244e1a5e48f8d48cbaaab, State: Running, Role: LEADER
I20260811 15:02:30.113785 12663 consensus_queue.cc:237] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } }
I20260811 15:02:30.114290 12656 sys_catalog.cc:564] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:30.115585 12665 sys_catalog.cc:455] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [sys.catalog]: SysCatalogTable state changed. Reason: New leader baefac94096244e1a5e48f8d48cbaaab. Latest consensus state: current_term: 1 leader_uuid: "baefac94096244e1a5e48f8d48cbaaab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } } }
I20260811 15:02:30.115736 12665 sys_catalog.cc:458] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:30.115998 12664 sys_catalog.cc:455] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baefac94096244e1a5e48f8d48cbaaab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baefac94096244e1a5e48f8d48cbaaab" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45789 } } }
I20260811 15:02:30.116096 12664 sys_catalog.cc:458] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:30.116230 12676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:30.119391 12676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:30.125113 12676 catalog_manager.cc:1347] Generated new cluster ID: 6d2ddca41012433d8727bb58b7adc64a
I20260811 15:02:30.125176 12676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:30.139171 12676 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:30.140021 12676 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:30.151638 12676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: Generated new TSK 0
I20260811 15:02:30.152544 12676 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:30.162919 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--builtin_ntp_servers=127.11.225.84:37557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:30.279407 12689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:30.279677 12689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:30.279716 12689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:30.283670 12689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:30.283728 12689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:30.283782 12689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:30.288398 12689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:30.289585 12689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:30.290951 12689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:30.300912 12703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.300925 12699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.300997 12701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.301337 12689 server_base.cc:1034] running on GCE node
I20260811 15:02:30.301748 12689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:30.302400 12689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:30.303608 12689 hybrid_clock.cc:648] HybridClock initialized: now 1786460550303593 us; error 25 us; skew 500 ppm
I20260811 15:02:30.305770 12689 webserver.cc:460] Webserver started at http://127.11.225.65:43629/ using document root <none> and password file <none>
I20260811 15:02:30.306391 12689 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:30.306489 12689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:30.306746 12689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:30.308897 12689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "6e88e962e4f247e290fb260ed2d6f60d"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "73b1c76a57fb2bf98e506897bd075f61"
server_key_iv: "1912ba9ab37824f1b044d2b9d9e79f31"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.309515 12689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "6e88e962e4f247e290fb260ed2d6f60d"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "73b1c76a57fb2bf98e506897bd075f61"
server_key_iv: "1912ba9ab37824f1b044d2b9d9e79f31"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.313422 12689 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:30.316077 12712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.317579 12689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:30.317682 12689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "6e88e962e4f247e290fb260ed2d6f60d"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "73b1c76a57fb2bf98e506897bd075f61"
server_key_iv: "1912ba9ab37824f1b044d2b9d9e79f31"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.317775 12689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:30.335304 12689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:30.335988 12689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:30.336149 12689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:30.336716 12689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:30.337788 12689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:30.337837 12689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.337878 12689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:30.337894 12689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.346758 12689 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:39747
I20260811 15:02:30.346829 12898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:39747 every 8 connection(s)
I20260811 15:02:30.347745 12689 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:30.350596 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12689
I20260811 15:02:30.350729 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:30.351089 12165 external_mini_cluster.cc:1428] Setting key 599bed407dd101d3a47a42bd972d754b
I20260811 15:02:30.353363 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--builtin_ntp_servers=127.11.225.84:37557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:30.358510 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.349735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:60231 (local address 127.11.225.126:45789)
0811 15:02:30.349946 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.349951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.351219 (+ 1268us) server_negotiation.cc:407] Connection header received
0811 15:02:30.352974 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.352977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.353054 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.353128 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:30.354401 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.354975 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.356298 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.356553 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.356680 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.358005 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:30.358008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:30.358010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:30.358022 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:30.358042 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:30.358050 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:30.358139 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.358301 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.358362 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 15:02:30.359378 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.350147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45789 (local address 127.11.225.65:60231)
0811 15:02:30.351034 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.351090 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.352738 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.353351 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.353360 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.353477 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:30.354218 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.354240 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.355189 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.355192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.356132 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.356143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.356730 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.356734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.356951 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.357711 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:30.357713 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:30.357754 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:30.357818 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:30.358143 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:30.358155 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:30.358162 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.358300 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.358601 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":177,"threads_started":1}
I20260811 15:02:30.360646 12899 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45789
I20260811 15:02:30.360939 12899 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:30.361691 12899 heartbeater.cc:511] Master 127.11.225.126:45789 requested a full tablet report, sending...
I20260811 15:02:30.363425 12583 ts_manager.cc:194] Registered new tserver with Master: 6e88e962e4f247e290fb260ed2d6f60d (127.11.225.65:39747)
I20260811 15:02:30.364614 12583 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.65:60231
W20260811 15:02:30.471764 12904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:30.472023 12904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:30.472060 12904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:30.476049 12904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:30.476109 12904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:30.476162 12904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:30.480937 12904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:30.482105 12904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:30.483601 12904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:30.493584 12912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.493610 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.493748 12904 server_base.cc:1034] running on GCE node
W20260811 15:02:30.493757 12914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.494295 12904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:30.494894 12904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:30.496086 12904 hybrid_clock.cc:648] HybridClock initialized: now 1786460550496053 us; error 43 us; skew 500 ppm
I20260811 15:02:30.498103 12904 webserver.cc:460] Webserver started at http://127.11.225.66:42151/ using document root <none> and password file <none>
I20260811 15:02:30.498667 12904 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:30.498728 12904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:30.498894 12904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:30.500950 12904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "0db0105c671c47a2a0d0ab9a67691c8b"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "9143ad9a15e9544d0bec7cd583f64a32"
server_key_iv: "f44caa9f9e055ce68697775fa6f6e476"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.501598 12904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "0db0105c671c47a2a0d0ab9a67691c8b"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "9143ad9a15e9544d0bec7cd583f64a32"
server_key_iv: "f44caa9f9e055ce68697775fa6f6e476"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.505522 12904 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:30.508095 12926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.509421 12904 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:30.509548 12904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "0db0105c671c47a2a0d0ab9a67691c8b"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "9143ad9a15e9544d0bec7cd583f64a32"
server_key_iv: "f44caa9f9e055ce68697775fa6f6e476"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.509663 12904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:30.535104 12904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:30.535872 12904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:30.536062 12904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:30.536767 12904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:30.537812 12904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:30.537863 12904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.537910 12904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:30.537971 12904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.546864 12904 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:33763
I20260811 15:02:30.546905 13120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:33763 every 8 connection(s)
I20260811 15:02:30.547830 12904 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:30.552780 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 12904
I20260811 15:02:30.552920 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:30.553270 12165 external_mini_cluster.cc:1428] Setting key bb6987b03fc37e6721c656ffa9dc6018
I20260811 15:02:30.555354 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--builtin_ntp_servers=127.11.225.84:37557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:30.558233 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.549769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:55523 (local address 127.11.225.126:45789)
0811 15:02:30.549942 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.549947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.551068 (+ 1121us) server_negotiation.cc:407] Connection header received
0811 15:02:30.552562 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.552566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.552631 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.552711 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:30.553926 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.554568 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.556020 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.556261 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.556377 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.557635 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:30.557641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:30.557647 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:30.557665 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:30.557694 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:30.557706 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:30.557791 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.557943 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.558024 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:02:30.558966 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.550199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45789 (local address 127.11.225.66:55523)
0811 15:02:30.550903 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.550948 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.552323 (+ 1375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.552941 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.552965 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.553076 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:30.553757 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.553779 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.554716 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.554721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.555895 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.555925 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.556421 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.556425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.556611 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.557323 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:30.557327 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:30.557384 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:30.557473 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:30.557803 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:30.557810 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:30.557815 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.557913 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.558136 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":115,"threads_started":1}
I20260811 15:02:30.560029 13121 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45789
I20260811 15:02:30.560307 13121 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:30.560827 13121 heartbeater.cc:511] Master 127.11.225.126:45789 requested a full tablet report, sending...
I20260811 15:02:30.561937 12583 ts_manager.cc:194] Registered new tserver with Master: 0db0105c671c47a2a0d0ab9a67691c8b (127.11.225.66:33763)
I20260811 15:02:30.562494 12583 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.66:55523
W20260811 15:02:30.674176 13129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:30.674475 13129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:30.674552 13129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:30.678516 13129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:30.678596 13129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:30.678683 13129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:30.683495 13129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:45789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:30.684603 13129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:30.686064 13129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:30.696014 13139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.696076 13138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:30.696070 13141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:30.696329 13129 server_base.cc:1034] running on GCE node
I20260811 15:02:30.696842 13129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:30.697582 13129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:30.698760 13129 hybrid_clock.cc:648] HybridClock initialized: now 1786460550698746 us; error 25 us; skew 500 ppm
I20260811 15:02:30.700651 13129 webserver.cc:460] Webserver started at http://127.11.225.67:44839/ using document root <none> and password file <none>
I20260811 15:02:30.701289 13129 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:30.701357 13129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:30.701572 13129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:30.703616 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "00922646be8a4e408fd00adb80100cf4"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "aae106d85cb0d2a6ae8445988f623746"
server_key_iv: "b55ab77a9c05addd3a9f89b5deba548f"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.704175 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "00922646be8a4e408fd00adb80100cf4"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "aae106d85cb0d2a6ae8445988f623746"
server_key_iv: "b55ab77a9c05addd3a9f89b5deba548f"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.707793 13129 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:02:30.710258 13151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.711436 13129 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:30.711560 13129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "00922646be8a4e408fd00adb80100cf4"
format_stamp: "Formatted at 2026-08-11 15:02:30 on dist-test-slave-8hhm"
server_key: "aae106d85cb0d2a6ae8445988f623746"
server_key_iv: "b55ab77a9c05addd3a9f89b5deba548f"
server_key_version: "encryptionkey@0"
I20260811 15:02:30.711659 13129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:30.731877 13129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:30.732587 13129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:30.732800 13129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:30.733454 13129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:30.734443 13129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:30.734489 13129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.734561 13129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:30.734594 13129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:30.744169 13129 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:40543
I20260811 15:02:30.744246 13332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:40543 every 8 connection(s)
I20260811 15:02:30.745139 13129 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:30.753911 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13129
I20260811 15:02:30.754094 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:30.754411 12165 external_mini_cluster.cc:1428] Setting key 80cb2cf2769af88c84ae6fb2a5481d6c
I20260811 15:02:30.754994 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.747125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:56387 (local address 127.11.225.126:45789)
0811 15:02:30.747276 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.747281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.748336 (+ 1055us) server_negotiation.cc:407] Connection header received
0811 15:02:30.749888 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.749891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.749953 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.750065 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:30.751049 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.751587 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.752788 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.753024 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.753141 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.754458 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:30.754465 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:30.754469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:30.754484 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:30.754514 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:30.754522 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:30.754612 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.754782 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.754846 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:02:30.756151 13339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.747508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:45789 (local address 127.11.225.67:56387)
0811 15:02:30.748182 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.748225 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.749666 (+ 1441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.750258 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.750265 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.750350 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:30.750896 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.750911 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.751737 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.751746 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.752654 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.752663 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.753188 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.753192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.753403 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.754168 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:30.754170 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:30.754233 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:30.754297 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:30.754614 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:30.754626 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:30.754635 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.754778 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.755202 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":112,"threads_started":1}
I20260811 15:02:30.757378 13333 heartbeater.cc:347] Connected to a master server at 127.11.225.126:45789
I20260811 15:02:30.757637 13333 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:30.758168 13333 heartbeater.cc:511] Master 127.11.225.126:45789 requested a full tablet report, sending...
I20260811 15:02:30.759192 12583 ts_manager.cc:194] Registered new tserver with Master: 00922646be8a4e408fd00adb80100cf4 (127.11.225.67:40543)
I20260811 15:02:30.759709 12583 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.67:56387
I20260811 15:02:30.768793 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:30.775199 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.771109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44996 (local address 127.11.225.126:45789)
0811 15:02:30.771257 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.771260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.771466 (+ 206us) server_negotiation.cc:407] Connection header received
0811 15:02:30.771579 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.771581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.771621 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.771689 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:30.771955 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.772474 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.773540 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.773759 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.773859 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.774812 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:30.774815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:30.774817 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:30.774827 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:30.774842 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:30.774850 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:30.774944 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.775052 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.775090 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:02:30.778323 12583 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:30.781333 12583 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:30.796759 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.790026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.11.225.67:40543)
0811 15:02:30.791053 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.791066 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.791092 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:02:30.791175 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.791181 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.791376 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.791918 (+ 542us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:30.792092 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793270 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.795118 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.795945 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.796090 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.796326 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.796472 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.796579 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":872,"thread_start_us":135,"threads_started":1}
I20260811 15:02:30.796773 13356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.789857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:40543 (local address 127.0.0.1:34428)
0811 15:02:30.790345 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.790394 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.790531 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.791563 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.791571 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.791613 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:30.791789 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.791796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793405 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.793410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.794977 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.794987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.796094 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.796096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.796237 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.796302 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.796427 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.796580 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":314,"spinlock_wait_cycles":5248,"thread_start_us":76,"threads_started":1}
I20260811 15:02:30.796774 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.790583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:39747 (local address 127.0.0.1:37788)
0811 15:02:30.791489 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.791503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.791609 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.792141 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.792144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.792162 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:30.792241 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.792247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793329 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.793333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.795172 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.795177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.796191 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.796195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.796262 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.796307 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.796427 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.796580 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":245,"spinlock_wait_cycles":3968,"thread_start_us":105,"threads_started":1}
I20260811 15:02:30.797459 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.790913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37788 (local address 127.11.225.65:39747)
0811 15:02:30.791323 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.791334 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.791724 (+ 390us) server_negotiation.cc:407] Connection header received
0811 15:02:30.791808 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.791813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.791999 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.792163 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:30.792368 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793157 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.795305 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.796075 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.796173 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.796326 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.797025 (+ 699us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.797132 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":131,"threads_started":1}
I20260811 15:02:30.798761 13357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.790023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:33763 (local address 127.0.0.1:53872)
0811 15:02:30.790677 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.790695 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.790792 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.791723 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.791726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.791744 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:30.791887 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.791893 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793357 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.793359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.795164 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.795177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.798304 (+ 3127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.798308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.798395 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.798423 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.798542 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.798618 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":474,"thread_start_us":132,"threads_started":1}
I20260811 15:02:30.798974 13360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.790620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.11.225.66:33763)
0811 15:02:30.790989 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.791004 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.791035 (+ 31us) server_negotiation.cc:407] Connection header received
0811 15:02:30.791134 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.791139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.791361 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.791529 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:30.792017 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.793253 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.796427 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.797935 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.798043 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.798229 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.798577 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.798795 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":110,"threads_started":1}
I20260811 15:02:30.800271 13222 tablet_service.cc:1467] Processing CreateTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 (DEFAULT_TABLE table=test-table [id=5bfe7753200f44fca71595a17f6cba74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:30.800271 12791 tablet_service.cc:1467] Processing CreateTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 (DEFAULT_TABLE table=test-table [id=5bfe7753200f44fca71595a17f6cba74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:30.801548 12791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e16e0bda91246d8a695e4543c2f0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:30.801548 13222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e16e0bda91246d8a695e4543c2f0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:30.801515 13009 tablet_service.cc:1467] Processing CreateTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 (DEFAULT_TABLE table=test-table [id=5bfe7753200f44fca71595a17f6cba74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:30.802470 13009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e16e0bda91246d8a695e4543c2f0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:30.808768 13365 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Bootstrap starting.
I20260811 15:02:30.810519 13368 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Bootstrap starting.
I20260811 15:02:30.811471 13365 tablet_bootstrap.cc:654] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:30.812441 13365 log.cc:824] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:30.812826 13368 tablet_bootstrap.cc:654] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:30.813351 13366 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Bootstrap starting.
I20260811 15:02:30.813840 13368 log.cc:824] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:30.814970 13365 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: No bootstrap required, opened a new log
I20260811 15:02:30.815171 13365 ts_tablet_manager.cc:1397] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 15:02:30.816128 13368 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: No bootstrap required, opened a new log
I20260811 15:02:30.816320 13368 ts_tablet_manager.cc:1397] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:02:30.819010 13366 tablet_bootstrap.cc:654] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:30.819736 13366 log.cc:824] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:30.819870 13365 raft_consensus.cc:348] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.820182 13365 raft_consensus.cc:374] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:30.820276 13365 raft_consensus.cc:729] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db0105c671c47a2a0d0ab9a67691c8b, State: Initialized, Role: FOLLOWER
I20260811 15:02:30.820667 13368 raft_consensus.cc:348] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.820807 13365 consensus_queue.cc:260] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.820928 13368 raft_consensus.cc:374] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:30.821031 13368 raft_consensus.cc:729] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00922646be8a4e408fd00adb80100cf4, State: Initialized, Role: FOLLOWER
I20260811 15:02:30.821535 13368 consensus_queue.cc:260] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.821847 13366 tablet_bootstrap.cc:492] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: No bootstrap required, opened a new log
I20260811 15:02:30.821907 13365 ts_tablet_manager.cc:1428] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 15:02:30.822281 13333 heartbeater.cc:503] Master 127.11.225.126:45789 was elected leader, sending a full tablet report...
I20260811 15:02:30.822288 13121 heartbeater.cc:503] Master 127.11.225.126:45789 was elected leader, sending a full tablet report...
I20260811 15:02:30.822595 13368 ts_tablet_manager.cc:1428] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:02:30.822105 13366 ts_tablet_manager.cc:1397] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 15:02:30.826738 13366 raft_consensus.cc:348] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.827064 13366 raft_consensus.cc:374] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:30.827133 13366 raft_consensus.cc:729] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e88e962e4f247e290fb260ed2d6f60d, State: Initialized, Role: FOLLOWER
I20260811 15:02:30.827571 13366 consensus_queue.cc:260] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.828398 12899 heartbeater.cc:503] Master 127.11.225.126:45789 was elected leader, sending a full tablet report...
I20260811 15:02:30.828650 13366 ts_tablet_manager.cc:1428] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260811 15:02:30.848987 12900 tablet.cc:2369] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:02:30.872061 13376 raft_consensus.cc:482] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:30.872363 13376 raft_consensus.cc:504] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.873790 13376 leader_election.cc:288] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00922646be8a4e408fd00adb80100cf4 (127.11.225.67:40543), 0db0105c671c47a2a0d0ab9a67691c8b (127.11.225.66:33763)
I20260811 15:02:30.878011 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.874298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:58293 (local address 127.11.225.67:40543)
0811 15:02:30.874497 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.874502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.874744 (+ 242us) server_negotiation.cc:407] Connection header received
0811 15:02:30.874890 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.874893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.874940 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.875023 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:30.875361 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.875864 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.876946 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.877398 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.877517 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.877575 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.877792 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.877870 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 15:02:30.878064 13360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.874225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:45825 (local address 127.11.225.66:33763)
0811 15:02:30.874380 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.874385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.874593 (+ 208us) server_negotiation.cc:407] Connection header received
0811 15:02:30.874706 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.874711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.874773 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.874871 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:30.875189 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.875775 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.876911 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.877408 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.877566 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.877629 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.877848 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.877935 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:02:30.878050 13378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.874070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:40543 (local address 127.11.225.65:58293)
0811 15:02:30.874604 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.874622 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.874744 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.875054 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.875056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.875073 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:30.875234 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.875241 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.875992 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.875995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.876780 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.876789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.877530 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.877535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.877633 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.877667 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.877748 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.877843 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":127,"thread_start_us":106,"threads_started":1}
I20260811 15:02:30.878036 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.874070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:33763 (local address 127.11.225.65:45825)
0811 15:02:30.874483 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.874498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:30.874609 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:30.874886 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:30.874889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:30.874908 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:30.875056 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.875064 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.875903 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.875909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.876771 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:30.876780 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.877588 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.877595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:30.877690 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.877708 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:02:30.877811 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:02:30.877873 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":5,"thread_start_us":106,"threads_started":1}
I20260811 15:02:30.878866 13044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e16e0bda91246d8a695e4543c2f0670" candidate_uuid: "6e88e962e4f247e290fb260ed2d6f60d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" is_pre_election: true
I20260811 15:02:30.878867 13266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e16e0bda91246d8a695e4543c2f0670" candidate_uuid: "6e88e962e4f247e290fb260ed2d6f60d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00922646be8a4e408fd00adb80100cf4" is_pre_election: true
I20260811 15:02:30.879191 13044 raft_consensus.cc:2454] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e88e962e4f247e290fb260ed2d6f60d in term 0.
I20260811 15:02:30.879206 13266 raft_consensus.cc:2454] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e88e962e4f247e290fb260ed2d6f60d in term 0.
I20260811 15:02:30.879726 12719 leader_election.cc:302] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 00922646be8a4e408fd00adb80100cf4, 0db0105c671c47a2a0d0ab9a67691c8b, 6e88e962e4f247e290fb260ed2d6f60d; no voters:
I20260811 15:02:30.880090 13376 raft_consensus.cc:2781] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:30.880175 13376 raft_consensus.cc:482] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:30.880206 13376 raft_consensus.cc:3037] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:30.881582 13376 raft_consensus.cc:504] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.882005 13376 leader_election.cc:288] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [CANDIDATE]: Term 1 election: Requested vote from peers 00922646be8a4e408fd00adb80100cf4 (127.11.225.67:40543), 0db0105c671c47a2a0d0ab9a67691c8b (127.11.225.66:33763)
I20260811 15:02:30.882373 13266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e16e0bda91246d8a695e4543c2f0670" candidate_uuid: "6e88e962e4f247e290fb260ed2d6f60d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00922646be8a4e408fd00adb80100cf4"
I20260811 15:02:30.882444 13044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e16e0bda91246d8a695e4543c2f0670" candidate_uuid: "6e88e962e4f247e290fb260ed2d6f60d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0db0105c671c47a2a0d0ab9a67691c8b"
I20260811 15:02:30.882534 13266 raft_consensus.cc:3037] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:30.882596 13044 raft_consensus.cc:3037] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:30.884196 13266 raft_consensus.cc:2454] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e88e962e4f247e290fb260ed2d6f60d in term 1.
I20260811 15:02:30.884219 13044 raft_consensus.cc:2454] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e88e962e4f247e290fb260ed2d6f60d in term 1.
I20260811 15:02:30.884596 12719 leader_election.cc:302] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0db0105c671c47a2a0d0ab9a67691c8b, 6e88e962e4f247e290fb260ed2d6f60d; no voters:
I20260811 15:02:30.884887 13376 raft_consensus.cc:2781] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:30.885254 13376 raft_consensus.cc:686] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [term 1 LEADER]: Becoming Leader. State: Replica: 6e88e962e4f247e290fb260ed2d6f60d, State: Running, Role: LEADER
I20260811 15:02:30.885732 13376 consensus_queue.cc:237] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } }
I20260811 15:02:30.890601 12582 catalog_manager.cc:5495] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e88e962e4f247e290fb260ed2d6f60d (127.11.225.65). New cstate: current_term: 1 leader_uuid: "6e88e962e4f247e290fb260ed2d6f60d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e88e962e4f247e290fb260ed2d6f60d" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 39747 } health_report { overall_health: HEALTHY } } }
I20260811 15:02:30.925352 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.921522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.11.225.65:39747)
0811 15:02:30.921652 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:30.921656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:30.921671 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:02:30.921846 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:30.921848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:30.921941 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:30.922100 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:30.922341 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.922907 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.923773 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:30.924001 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:30.924095 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:30.924359 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:30.924810 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:30.924922 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:30.925073 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 15:02:30.925142 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:02:30.931423 13044 raft_consensus.cc:1261] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 1 FOLLOWER]: Refusing update from remote peer 6e88e962e4f247e290fb260ed2d6f60d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:30.931419 13266 raft_consensus.cc:1261] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 1 FOLLOWER]: Refusing update from remote peer 6e88e962e4f247e290fb260ed2d6f60d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:30.932197 13379 consensus_queue.cc:1035] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0db0105c671c47a2a0d0ab9a67691c8b" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:30.932412 13376 consensus_queue.cc:1035] T 5e16e0bda91246d8a695e4543c2f0670 P 6e88e962e4f247e290fb260ed2d6f60d [LEADER]: Connected to new peer: Peer: permanent_uuid: "00922646be8a4e408fd00adb80100cf4" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 40543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:30.950736 12582 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:30.950937 12582 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:30.953477 12582 catalog_manager.cc:5782] T 00000000000000000000000000000000 P baefac94096244e1a5e48f8d48cbaaab: Sending DeleteTablet for 3 replicas of tablet 5e16e0bda91246d8a695e4543c2f0670
I20260811 15:02:30.954463 13009 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:30 UTC) from {username='slave'} at 127.0.0.1:53872
I20260811 15:02:30.954530 13222 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:30 UTC) from {username='slave'} at 127.0.0.1:34428
I20260811 15:02:30.955035 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12689
I20260811 15:02:30.954990 12791 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e16e0bda91246d8a695e4543c2f0670 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:30 UTC) from {username='slave'} at 127.0.0.1:37788
I20260811 15:02:30.958285 13411 tablet_replica.cc:330] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: stopping tablet replica
I20260811 15:02:30.958745 13411 raft_consensus.cc:2229] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:30.959152 13411 raft_consensus.cc:2258] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:30.959630 13407 tablet_replica.cc:330] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: stopping tablet replica
I20260811 15:02:30.960013 13407 raft_consensus.cc:2229] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:30.960381 13407 raft_consensus.cc:2258] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:30.964111 13407 ts_tablet_manager.cc:1905] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:30.967360 13407 ts_tablet_manager.cc:1918] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:30.967491 13407 log.cc:1196] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/5e16e0bda91246d8a695e4543c2f0670
I20260811 15:02:30.967904 13407 ts_tablet_manager.cc:1939] T 5e16e0bda91246d8a695e4543c2f0670 P 0db0105c671c47a2a0d0ab9a67691c8b: Deleting consensus metadata
I20260811 15:02:30.968899 13411 ts_tablet_manager.cc:1905] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:30.969379 12566 catalog_manager.cc:4841] TS 0db0105c671c47a2a0d0ab9a67691c8b (127.11.225.66:33763): tablet 5e16e0bda91246d8a695e4543c2f0670 (table test-table [id=5bfe7753200f44fca71595a17f6cba74]) successfully deleted
I20260811 15:02:30.971590 13411 ts_tablet_manager.cc:1918] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:30.971688 13411 log.cc:1196] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/5e16e0bda91246d8a695e4543c2f0670
I20260811 15:02:30.972072 13411 ts_tablet_manager.cc:1939] T 5e16e0bda91246d8a695e4543c2f0670 P 00922646be8a4e408fd00adb80100cf4: Deleting consensus metadata
I20260811 15:02:30.973346 12564 catalog_manager.cc:4841] TS 00922646be8a4e408fd00adb80100cf4 (127.11.225.67:40543): tablet 5e16e0bda91246d8a695e4543c2f0670 (table test-table [id=5bfe7753200f44fca71595a17f6cba74]) successfully deleted
I20260811 15:02:30.974630 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12904
W20260811 15:02:30.974617 12564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:39747 (error 108)
I20260811 15:02:30.987202 13357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:30.986864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:39747 (local address 127.0.0.1:37814)
0811 15:02:30.987030 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:30.987110 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:39747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 15:02:30.987459 12564 catalog_manager.cc:4584] TS 6e88e962e4f247e290fb260ed2d6f60d (127.11.225.65:39747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e16e0bda91246d8a695e4543c2f0670: Network error: Client connection negotiation failed: client connection to 127.11.225.65:39747: connect: Connection refused (error 111)
I20260811 15:02:30.992929 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13129
I20260811 15:02:30.999775 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 12543
2026-08-11T15:02:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1140 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:31 dist-test-slave-8hhm krb5kdc[13421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:31 dist-test-slave-8hhm krb5kdc[13421](info): set up 2 sockets
Aug 11 15:02:31 dist-test-slave-8hhm krb5kdc[13421](info): commencing operation
krb5kdc: starting...
W20260811 15:02:32.335618 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:32 dist-test-slave-8hhm krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:02:32.472846 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40843
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:32.610121 13442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:32.610430 13442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:32.610510 13442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:32.614611 13442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:32.614696 13442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:32.614735 13442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:32.614797 13442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:32.614837 13442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:32.620246 13442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:32.621415 13442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:32.622463 13442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:32.630993 13452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:32.630995 13455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:32.631040 13451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:32.631382 13442 server_base.cc:1034] running on GCE node
I20260811 15:02:32.632014 13442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:32.633124 13442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:32.634291 13442 hybrid_clock.cc:648] HybridClock initialized: now 1786460552634269 us; error 33 us; skew 500 ppm
Aug 11 15:02:32 dist-test-slave-8hhm krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460552, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:32.637135 13442 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:32.638077 13442 webserver.cc:460] Webserver started at http://127.11.225.126:46781/ using document root <none> and password file <none>
I20260811 15:02:32.638660 13442 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:32.638724 13442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:32.638975 13442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:32.641125 13442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "ae200670bbb549d9af34d78209a55a90"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "f8c69b229b96a005a55161e849d51f32"
server_key_iv: "66f4681df2acabd482f8866108b922e2"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.641760 13442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "ae200670bbb549d9af34d78209a55a90"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "f8c69b229b96a005a55161e849d51f32"
server_key_iv: "66f4681df2acabd482f8866108b922e2"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.645742 13442 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:02:32.648193 13469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:32.649791 13442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:32.650085 13442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "ae200670bbb549d9af34d78209a55a90"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "f8c69b229b96a005a55161e849d51f32"
server_key_iv: "66f4681df2acabd482f8866108b922e2"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.650214 13442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:32.665656 13442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:32.668732 13442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:32.668952 13442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:32.676450 13442 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:40843
I20260811 15:02:32.676470 13556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:40843 every 8 connection(s)
I20260811 15:02:32.677453 13442 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:32.680419 13557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:32.681821 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13442
I20260811 15:02:32.681970 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:32.682279 12165 external_mini_cluster.cc:1428] Setting key d2ecb108b1bc8a2f8f7b4bc263ff3518
I20260811 15:02:32.687328 13557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: Bootstrap starting.
I20260811 15:02:32.690029 13557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:32.690822 13557 log.cc:824] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:02:32 dist-test-slave-8hhm krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:32.693104 13557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: No bootstrap required, opened a new log
I20260811 15:02:32.697947 13557 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } }
I20260811 15:02:32.698239 13557 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:32.698298 13557 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae200670bbb549d9af34d78209a55a90, State: Initialized, Role: FOLLOWER
I20260811 15:02:32.698622 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:32.683763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46462 (local address 127.11.225.126:40843)
0811 15:02:32.684214 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:32.684233 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:32.684278 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:02:32.685131 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:32.685157 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:32.685604 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:32.685981 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:32.686689 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.688131 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.689001 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.689695 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.689865 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:32.693098 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:32.693105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:32.693123 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:32.693158 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:32.695155 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:32.695645 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:32.695653 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:32.695663 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:32.695814 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:32.696168 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:32.696172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:32.696173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:32.696701 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:32.696898 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:32.697285 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 15:02:32.697599 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":109,"threads_started":1}
I20260811 15:02:32.698784 13557 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } }
I20260811 15:02:32.698953 13557 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:32.699021 13557 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:32.699122 13557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:32.700198 13557 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } }
I20260811 15:02:32.700555 13557 leader_election.cc:302] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae200670bbb549d9af34d78209a55a90; no voters:
I20260811 15:02:32.700886 13557 leader_election.cc:288] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:32.701025 13565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:32.701292 13565 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [term 1 LEADER]: Becoming Leader. State: Replica: ae200670bbb549d9af34d78209a55a90, State: Running, Role: LEADER
I20260811 15:02:32.701598 13565 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } }
I20260811 15:02:32.702189 13557 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:32.703397 13567 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae200670bbb549d9af34d78209a55a90. Latest consensus state: current_term: 1 leader_uuid: "ae200670bbb549d9af34d78209a55a90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } } }
I20260811 15:02:32.703536 13567 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:32.703390 13566 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae200670bbb549d9af34d78209a55a90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae200670bbb549d9af34d78209a55a90" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40843 } } }
I20260811 15:02:32.703811 13566 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90 [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:32.707082 13585 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:32.707146 13585 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:32.707227 13576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:32.707901 13576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:32.713047 13576 catalog_manager.cc:1347] Generated new cluster ID: 03eec51f47834c2ba837d63bcc2e7569
I20260811 15:02:32.713107 13576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:32.726857 13576 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:32.727771 13576 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:32.731370 13576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: Generated new TSK 0
I20260811 15:02:32.732033 13576 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.225.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
Entry for principal kudu/127.11.225.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab.
I20260811 15:02:32.772253 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:32.895816 13590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:32.896113 13590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:32.896163 13590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:32.900334 13590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:32.900400 13590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:32.900463 13590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:32.906185 13590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.65.keytab
--principal=kudu/127.11.225.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:32.907213 13590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:32.908207 13590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:32.918385 13603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:32.918403 13598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:32.918452 13600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:32.918823 13590 server_base.cc:1034] running on GCE node
I20260811 15:02:32.919262 13590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:32.919902 13590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:32.921082 13590 hybrid_clock.cc:648] HybridClock initialized: now 1786460552921066 us; error 29 us; skew 500 ppm
Aug 11 15:02:32 dist-test-slave-8hhm krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460552, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:32.924017 13590 init.cc:377] Logged in from keytab as kudu/127.11.225.65@KRBTEST.COM (short username kudu)
I20260811 15:02:32.924878 13590 webserver.cc:460] Webserver started at http://127.11.225.65:39369/ using document root <none> and password file <none>
I20260811 15:02:32.925525 13590 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:32.925628 13590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:32.925863 13590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:32.927862 13590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "6d682fe861904df282f030c99e82af0a"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "e83c6609b2ab639076ff7e188d0b516c"
server_key_iv: "79f1767a69395f5dfceb7d2cc5f6929f"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.928440 13590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "6d682fe861904df282f030c99e82af0a"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "e83c6609b2ab639076ff7e188d0b516c"
server_key_iv: "79f1767a69395f5dfceb7d2cc5f6929f"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.932153 13590 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:02:32.934569 13611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:32.935792 13590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:32.935928 13590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "6d682fe861904df282f030c99e82af0a"
format_stamp: "Formatted at 2026-08-11 15:02:32 on dist-test-slave-8hhm"
server_key: "e83c6609b2ab639076ff7e188d0b516c"
server_key_iv: "79f1767a69395f5dfceb7d2cc5f6929f"
server_key_version: "encryptionkey@0"
I20260811 15:02:32.936038 13590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:32.971634 13590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:32.975018 13590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:32.975250 13590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:32.975909 13590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:32.976807 13590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:32.976891 13590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:32.976979 13590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:32.977029 13590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:32.986249 13590 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:45355
I20260811 15:02:32.986277 13798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:45355 every 8 connection(s)
I20260811 15:02:32.987170 13590 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:32.990518 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13590
I20260811 15:02:32.990669 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:32.991006 12165 external_mini_cluster.cc:1428] Setting key c2164c23988149ba5cd55432a7217b46
Aug 11 15:02:32 dist-test-slave-8hhm krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460552, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.65@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.66@KRBTEST.COM; defaulting to no policy
I20260811 15:02:33.003221 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:32.989437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:46633 (local address 127.11.225.126:40843)
0811 15:02:32.989587 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:32.989591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:32.990415 (+ 824us) server_negotiation.cc:407] Connection header received
0811 15:02:32.992085 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:32.992088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:32.992147 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:32.992228 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:32.993548 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.994090 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.995852 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.996124 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.996221 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:32.999093 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:32.999097 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:32.999100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:32.999132 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:33.000666 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.001375 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.001377 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.001379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.001461 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.001912 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.001915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.001916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.002139 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:33.002297 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.002893 (+ 596us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.003049 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:02:33.004233 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:32.989816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40843 (local address 127.11.225.65:46633)
0811 15:02:32.990261 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:32.990305 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:32.991867 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:32.992408 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:32.992418 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:32.992800 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:32.993392 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:32.993408 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.994241 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.994244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:32.995698 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:32.995712 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:32.996283 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:32.996286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:32.996469 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:32.997117 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:32.997134 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:32.998830 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:33.000801 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.000808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.000826 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.001255 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.001559 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.001562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.001564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.001777 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.002292 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:33.002299 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:33.002575 (+ 276us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.002821 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.003317 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":114,"threads_started":1}
I20260811 15:02:33.005599 13799 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40843
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.66@KRBTEST.COM" created.
I20260811 15:02:33.005903 13799 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:33.006518 13799 heartbeater.cc:511] Master 127.11.225.126:40843 requested a full tablet report, sending...
I20260811 15:02:33.008404 13489 ts_manager.cc:194] Registered new tserver with Master: 6d682fe861904df282f030c99e82af0a (127.11.225.65:45355)
I20260811 15:02:33.010097 13489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.65@KRBTEST.COM'} at 127.11.225.65:46633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
Entry for principal kudu/127.11.225.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab.
I20260811 15:02:33.025393 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:33.142895 13806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:33.143203 13806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:33.143289 13806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:33.147704 13806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:33.147805 13806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:33.147897 13806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:33.153338 13806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.66.keytab
--principal=kudu/127.11.225.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:33.154449 13806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:33.155541 13806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:33.165459 13813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:33.165578 13806 server_base.cc:1034] running on GCE node
W20260811 15:02:33.165511 13816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:33.165519 13812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:33.166296 13806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:33.166929 13806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:33.168123 13806 hybrid_clock.cc:648] HybridClock initialized: now 1786460553168106 us; error 31 us; skew 500 ppm
Aug 11 15:02:33 dist-test-slave-8hhm krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460553, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:33.171034 13806 init.cc:377] Logged in from keytab as kudu/127.11.225.66@KRBTEST.COM (short username kudu)
I20260811 15:02:33.171979 13806 webserver.cc:460] Webserver started at http://127.11.225.66:44953/ using document root <none> and password file <none>
I20260811 15:02:33.172555 13806 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:33.172617 13806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:33.172838 13806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:33.174976 13806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "1433fa9acc91624735d71343dda236fa"
server_key_iv: "a8ebbb8f3d5430189a3a1913c3d46395"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.175588 13806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "1433fa9acc91624735d71343dda236fa"
server_key_iv: "a8ebbb8f3d5430189a3a1913c3d46395"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.179438 13806 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:33.181949 13831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.183303 13806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:33.183403 13806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "1433fa9acc91624735d71343dda236fa"
server_key_iv: "a8ebbb8f3d5430189a3a1913c3d46395"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.183542 13806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:33.203245 13806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:33.206569 13806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:33.206772 13806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:33.207379 13806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:33.208221 13806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:33.208279 13806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.208345 13806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:33.208387 13806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.217811 13806 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:39157
I20260811 15:02:33.217839 14013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:39157 every 8 connection(s)
I20260811 15:02:33.218711 13806 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:33.223098 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 13806
I20260811 15:02:33.223242 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:33.223510 12165 external_mini_cluster.cc:1428] Setting key 3e19d0b0e6bb486d1ffd3969f7881cd0
Aug 11 15:02:33 dist-test-slave-8hhm krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460553, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.66@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:33.233390 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.220519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:33985 (local address 127.11.225.126:40843)
0811 15:02:33.220684 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.220688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.221589 (+ 901us) server_negotiation.cc:407] Connection header received
0811 15:02:33.222943 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.222947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.223006 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.223138 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:33.224589 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.225208 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.226402 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.226628 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.226756 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.229402 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:33.229405 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:33.229407 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:33.229430 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:33.231071 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.231676 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.231685 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.231687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.231775 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.232139 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.232144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.232146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.232334 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:33.232444 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.233080 (+ 636us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.233205 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:02:33.234239 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.220912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40843 (local address 127.11.225.66:33985)
0811 15:02:33.221425 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.221469 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.222726 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.223341 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.223352 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.223782 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:33.224422 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.224438 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.225382 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.225391 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.226271 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.226280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.226798 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.226802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.226971 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.227645 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:33.227661 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:33.229181 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:33.231209 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.231215 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.231230 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.231561 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.231876 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.231880 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.231882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.232038 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.232463 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:33.232472 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:33.232814 (+ 342us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.233030 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.233394 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.11.225.67@KRBTEST.COM; defaulting to no policy
I20260811 15:02:33.235529 14016 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40843
I20260811 15:02:33.235774 14016 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:33.236243 14016 heartbeater.cc:511] Master 127.11.225.126:40843 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.67@KRBTEST.COM" created.
I20260811 15:02:33.237550 13489 ts_manager.cc:194] Registered new tserver with Master: b098c9e4c3b24528a6ad2dad78ca1fbf (127.11.225.66:39157)
I20260811 15:02:33.238132 13489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.66@KRBTEST.COM'} at 127.11.225.66:33985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
Entry for principal kudu/127.11.225.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab.
I20260811 15:02:33.254441 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:33.371928 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:33.372202 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:33.372246 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:33.376159 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:33.376214 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:33.376269 14024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:33.381532 14024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.67.keytab
--principal=kudu/127.11.225.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:33.382560 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:33.383545 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:33.393554 14034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:33.393541 14038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:33.393524 14035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:33.393625 14024 server_base.cc:1034] running on GCE node
I20260811 15:02:33.394156 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:33.394817 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:33.395977 14024 hybrid_clock.cc:648] HybridClock initialized: now 1786460553395943 us; error 50 us; skew 500 ppm
Aug 11 15:02:33 dist-test-slave-8hhm krb5kdc[13421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460553, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:33.398969 14024 init.cc:377] Logged in from keytab as kudu/127.11.225.67@KRBTEST.COM (short username kudu)
I20260811 15:02:33.399863 14024 webserver.cc:460] Webserver started at http://127.11.225.67:46365/ using document root <none> and password file <none>
I20260811 15:02:33.400429 14024 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:33.400491 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:33.400774 14024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:33.403036 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "b897831c95244a1bb26358a6bdb829cc"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "fb9df8e2aca6d4c90906b7187668dd64"
server_key_iv: "60f42553946c49e38f81f81e424c3ebd"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.403611 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "b897831c95244a1bb26358a6bdb829cc"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "fb9df8e2aca6d4c90906b7187668dd64"
server_key_iv: "60f42553946c49e38f81f81e424c3ebd"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.407496 14024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:33.410069 14048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.411358 14024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:33.411485 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "b897831c95244a1bb26358a6bdb829cc"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "fb9df8e2aca6d4c90906b7187668dd64"
server_key_iv: "60f42553946c49e38f81f81e424c3ebd"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.411604 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:33.430821 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:33.434242 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:33.434454 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:33.435127 14024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:33.435998 14024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:33.436048 14024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.436120 14024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:33.436161 14024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.445709 14024 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:36065
I20260811 15:02:33.445741 14234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:36065 every 8 connection(s)
I20260811 15:02:33.446621 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:33.451777 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14024
I20260811 15:02:33.451939 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:33.452301 12165 external_mini_cluster.cc:1428] Setting key d1b7d2c8868cfee3232c9d325c42f74e
Aug 11 15:02:33 dist-test-slave-8hhm krb5kdc[13421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460553, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.67@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:33.460954 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.448445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:60949 (local address 127.11.225.126:40843)
0811 15:02:33.448595 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.448599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.449559 (+ 960us) server_negotiation.cc:407] Connection header received
0811 15:02:33.450924 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.450927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.450991 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.451087 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:33.452425 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.453083 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.454852 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.455139 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.455224 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.457756 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:33.457760 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:33.457762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:33.457787 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:33.459169 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.459641 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.459643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.459645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.459720 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.460022 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.460025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.460026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.460206 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:33.460281 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.460732 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.460831 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:02:33.461869 14239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.448792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:40843 (local address 127.11.225.67:60949)
0811 15:02:33.449390 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.449436 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.450696 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.451280 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.451287 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.451657 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:33.452264 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.452279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.453276 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.453279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.454677 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.454688 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.455273 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.455275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.455415 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.456049 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:02:33.456066 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:33.457601 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:33.459282 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.459287 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.459299 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.459549 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.459797 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:02:33.459799 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:02:33.459800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:02:33.459928 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:02:33.460292 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:33.460297 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:33.460523 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.460672 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.460918 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":120,"threads_started":1}
I20260811 15:02:33.463124 14236 heartbeater.cc:347] Connected to a master server at 127.11.225.126:40843
I20260811 15:02:33.463400 14236 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:33.463937 14236 heartbeater.cc:511] Master 127.11.225.126:40843 requested a full tablet report, sending...
I20260811 15:02:33.464994 13489 ts_manager.cc:194] Registered new tserver with Master: b897831c95244a1bb26358a6bdb829cc (127.11.225.67:36065)
I20260811 15:02:33.465723 13489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.225.67@KRBTEST.COM'} at 127.11.225.67:60949
I20260811 15:02:33.466740 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:33.476361 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.469014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.11.225.126:40843)
0811 15:02:33.469171 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.469176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.469362 (+ 186us) server_negotiation.cc:407] Connection header received
0811 15:02:33.469467 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.469469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.469508 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.469583 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:33.470297 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.470800 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.471642 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.471869 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.471944 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.473376 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:33.473379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:33.473381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:33.473403 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:33.474867 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.475249 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.475252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.475253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.475327 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:33.475564 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:33.475567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:33.475568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:33.475775 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:33.475881 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.476072 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.476167 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 15:02:33.479368 13489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:33.482427 13489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:33.497824 14255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.491420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:36065 (local address 127.0.0.1:53380)
0811 15:02:33.491806 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.491857 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.491985 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.493374 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.493380 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.493406 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:33.493614 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.493623 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.494763 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.494767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.496136 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.496148 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497385 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.497392 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.497489 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.497511 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.497563 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.497645 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":123,"threads_started":1}
I20260811 15:02:33.497895 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.492347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.11.225.66:39157)
0811 15:02:33.492672 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.492686 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.492712 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:02:33.492796 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.492804 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.493052 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.493245 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:33.493775 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.494998 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.496481 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497325 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.497425 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.497588 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.497656 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.497758 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":138,"threads_started":1}
I20260811 15:02:33.497826 14259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.492226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45355 (local address 127.0.0.1:33538)
0811 15:02:33.492773 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.492786 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.492868 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.493593 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.493596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.493611 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:33.493732 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.493739 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.495153 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.495156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.496307 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.496314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497145 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.497149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.497313 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.497363 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.497474 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.497626 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":35,"thread_start_us":102,"threads_started":1}
I20260811 15:02:33.497826 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.491460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:39157 (local address 127.0.0.1:37460)
0811 15:02:33.492447 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.492464 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.492574 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.493422 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.493426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.493444 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:33.493638 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.493647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.495185 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.495188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.496335 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.496348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497440 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.497447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.497534 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.497555 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.497608 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.497661 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"mutex_wait_us":50,"thread_start_us":121,"threads_started":1}
I20260811 15:02:33.498178 14261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.492428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.11.225.65:45355)
0811 15:02:33.493119 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.493136 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.493162 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:02:33.493260 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.493265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.493444 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.493627 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:33.493826 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.495005 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.496424 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497003 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.497146 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.497340 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.497922 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.498026 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":136,"threads_started":1}
I20260811 15:02:33.498948 14257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.491530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53380 (local address 127.11.225.67:36065)
0811 15:02:33.492834 (+ 1304us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.492848 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.492871 (+ 23us) server_negotiation.cc:407] Connection header received
0811 15:02:33.492949 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.492954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.493168 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.493781 (+ 613us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:33.493921 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.494632 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.496273 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.497198 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.498491 (+ 1293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.498674 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.498724 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.498816 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1191,"thread_start_us":102,"threads_started":1}
I20260811 15:02:33.501017 13916 tablet_service.cc:1467] Processing CreateTablet for tablet 430914f416c34093913abbf47a1948ee (DEFAULT_TABLE table=test-table [id=2e613f6ccfd64f32a6cae08c32265a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:33.501017 13687 tablet_service.cc:1467] Processing CreateTablet for tablet 430914f416c34093913abbf47a1948ee (DEFAULT_TABLE table=test-table [id=2e613f6ccfd64f32a6cae08c32265a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:33.502187 13687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 430914f416c34093913abbf47a1948ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:33.502218 13916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 430914f416c34093913abbf47a1948ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:33.504120 14123 tablet_service.cc:1467] Processing CreateTablet for tablet 430914f416c34093913abbf47a1948ee (DEFAULT_TABLE table=test-table [id=2e613f6ccfd64f32a6cae08c32265a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:33.505194 14123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 430914f416c34093913abbf47a1948ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:33.508975 14262 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: Bootstrap starting.
I20260811 15:02:33.510434 14263 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Bootstrap starting.
I20260811 15:02:33.511451 14262 tablet_bootstrap.cc:654] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:33.512166 14264 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Bootstrap starting.
I20260811 15:02:33.512377 14262 log.cc:824] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:33.512950 14263 tablet_bootstrap.cc:654] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:33.514297 14263 log.cc:824] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:33.514505 14264 tablet_bootstrap.cc:654] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:33.515113 14262 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: No bootstrap required, opened a new log
I20260811 15:02:33.515375 14262 ts_tablet_manager.cc:1397] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:02:33.515856 14264 log.cc:824] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:33.516491 14263 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: No bootstrap required, opened a new log
I20260811 15:02:33.516688 14263 ts_tablet_manager.cc:1397] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 15:02:33.517706 14264 tablet_bootstrap.cc:492] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: No bootstrap required, opened a new log
I20260811 15:02:33.517903 14264 ts_tablet_manager.cc:1397] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 15:02:33.519979 14262 raft_consensus.cc:348] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.520289 14262 raft_consensus.cc:374] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:33.520344 14262 raft_consensus.cc:729] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d682fe861904df282f030c99e82af0a, State: Initialized, Role: FOLLOWER
I20260811 15:02:33.520605 14263 raft_consensus.cc:348] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.520835 14263 raft_consensus.cc:374] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:33.520884 14263 raft_consensus.cc:729] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b098c9e4c3b24528a6ad2dad78ca1fbf, State: Initialized, Role: FOLLOWER
I20260811 15:02:33.520834 14262 consensus_queue.cc:260] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.520782 14264 raft_consensus.cc:348] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.521030 14264 raft_consensus.cc:374] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:33.521080 14264 raft_consensus.cc:729] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b897831c95244a1bb26358a6bdb829cc, State: Initialized, Role: FOLLOWER
I20260811 15:02:33.521366 14263 consensus_queue.cc:260] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.521481 14264 consensus_queue.cc:260] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.521910 14262 ts_tablet_manager.cc:1428] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260811 15:02:33.522269 14236 heartbeater.cc:503] Master 127.11.225.126:40843 was elected leader, sending a full tablet report...
I20260811 15:02:33.522272 13799 heartbeater.cc:503] Master 127.11.225.126:40843 was elected leader, sending a full tablet report...
I20260811 15:02:33.522285 14263 ts_tablet_manager.cc:1428] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:02:33.522568 14016 heartbeater.cc:503] Master 127.11.225.126:40843 was elected leader, sending a full tablet report...
I20260811 15:02:33.523805 14264 ts_tablet_manager.cc:1428] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:02:33.538457 14274 raft_consensus.cc:482] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:33.538650 14274 raft_consensus.cc:504] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.540083 14274 leader_election.cc:288] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b098c9e4c3b24528a6ad2dad78ca1fbf (127.11.225.66:39157), 6d682fe861904df282f030c99e82af0a (127.11.225.65:45355)
I20260811 15:02:33.545527 14261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.540696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:39663 (local address 127.11.225.65:45355)
0811 15:02:33.540836 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.540839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.540851 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:02:33.540941 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.540943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.540996 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.541094 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:33.541624 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.542406 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544153 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.544770 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544898 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.544954 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.545316 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.545387 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 15:02:33.545527 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.540443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:38083 (local address 127.11.225.66:39157)
0811 15:02:33.540576 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.540583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.540918 (+ 335us) server_negotiation.cc:407] Connection header received
0811 15:02:33.540971 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.540974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.541023 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.541101 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:33.541621 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.542406 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544153 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.544770 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544898 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.544954 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.545316 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.545387 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:02:33.545583 14239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.540288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45355 (local address 127.11.225.67:39663)
0811 15:02:33.540425 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.540459 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.540566 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.541112 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.541115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.541153 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:33.541485 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.541494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.542528 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.542541 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.543993 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.544005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.544898 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.545096 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.545189 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.545292 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.545400 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":310,"spinlock_wait_cycles":5120}
I20260811 15:02:33.545614 14275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.540292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:39157 (local address 127.11.225.67:38083)
0811 15:02:33.540795 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.540809 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:33.540913 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:33.541112 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:33.541115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:33.541154 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:33.541487 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.541493 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.542528 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.542531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.543993 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:33.544005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.544898 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.544902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:33.545116 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.545189 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 15:02:33.545292 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:02:33.545400 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":415,"spinlock_wait_cycles":33664,"thread_start_us":161,"threads_started":1}
I20260811 15:02:33.546231 13727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "430914f416c34093913abbf47a1948ee" candidate_uuid: "b897831c95244a1bb26358a6bdb829cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d682fe861904df282f030c99e82af0a" is_pre_election: true
I20260811 15:02:33.546321 13943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "430914f416c34093913abbf47a1948ee" candidate_uuid: "b897831c95244a1bb26358a6bdb829cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" is_pre_election: true
I20260811 15:02:33.546581 13727 raft_consensus.cc:2454] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b897831c95244a1bb26358a6bdb829cc in term 0.
I20260811 15:02:33.546639 13943 raft_consensus.cc:2454] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b897831c95244a1bb26358a6bdb829cc in term 0.
I20260811 15:02:33.547139 14053 leader_election.cc:302] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d682fe861904df282f030c99e82af0a, b098c9e4c3b24528a6ad2dad78ca1fbf, b897831c95244a1bb26358a6bdb829cc; no voters:
I20260811 15:02:33.547432 14274 raft_consensus.cc:2781] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:33.547523 14274 raft_consensus.cc:482] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:33.547566 14274 raft_consensus.cc:3037] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:33.548628 14274 raft_consensus.cc:504] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.548985 14274 leader_election.cc:288] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [CANDIDATE]: Term 1 election: Requested vote from peers b098c9e4c3b24528a6ad2dad78ca1fbf (127.11.225.66:39157), 6d682fe861904df282f030c99e82af0a (127.11.225.65:45355)
I20260811 15:02:33.549347 13943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "430914f416c34093913abbf47a1948ee" candidate_uuid: "b897831c95244a1bb26358a6bdb829cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf"
I20260811 15:02:33.549391 13727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "430914f416c34093913abbf47a1948ee" candidate_uuid: "b897831c95244a1bb26358a6bdb829cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d682fe861904df282f030c99e82af0a"
I20260811 15:02:33.549460 13943 raft_consensus.cc:3037] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:33.549537 13727 raft_consensus.cc:3037] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:33.550566 13943 raft_consensus.cc:2454] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b897831c95244a1bb26358a6bdb829cc in term 1.
I20260811 15:02:33.550674 13727 raft_consensus.cc:2454] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b897831c95244a1bb26358a6bdb829cc in term 1.
I20260811 15:02:33.550923 14053 leader_election.cc:302] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b098c9e4c3b24528a6ad2dad78ca1fbf, b897831c95244a1bb26358a6bdb829cc; no voters:
I20260811 15:02:33.551100 14274 raft_consensus.cc:2781] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:33.551345 14274 raft_consensus.cc:686] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 1 LEADER]: Becoming Leader. State: Replica: b897831c95244a1bb26358a6bdb829cc, State: Running, Role: LEADER
I20260811 15:02:33.551755 14274 consensus_queue.cc:237] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } }
I20260811 15:02:33.555403 13489 catalog_manager.cc:5495] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b897831c95244a1bb26358a6bdb829cc (127.11.225.67). New cstate: current_term: 1 leader_uuid: "b897831c95244a1bb26358a6bdb829cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897831c95244a1bb26358a6bdb829cc" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 36065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 } health_report { overall_health: UNKNOWN } } }
I20260811 15:02:33.576273 14257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.572878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53384 (local address 127.11.225.67:36065)
0811 15:02:33.573029 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.573032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.573047 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:02:33.573145 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.573147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.573201 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.573356 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:33.573580 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.574091 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.574902 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.575129 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.575206 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.575466 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:33.575876 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:33.575966 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.576033 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.576081 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:02:33.582039 13727 raft_consensus.cc:1261] T 430914f416c34093913abbf47a1948ee P 6d682fe861904df282f030c99e82af0a [term 1 FOLLOWER]: Refusing update from remote peer b897831c95244a1bb26358a6bdb829cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:33.582042 13943 raft_consensus.cc:1261] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 1 FOLLOWER]: Refusing update from remote peer b897831c95244a1bb26358a6bdb829cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:33.582782 14278 consensus_queue.cc:1035] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d682fe861904df282f030c99e82af0a" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:33.582952 14274 consensus_queue.cc:1035] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b098c9e4c3b24528a6ad2dad78ca1fbf" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 39157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:33.594866 14284 mvcc.cc:205] Tried to move back new op lower bound from 7317342427464986624 to 7317342427351523328. Current Snapshot: MvccSnapshot[applied={T|T < 7317342427464986624}]
I20260811 15:02:33.599678 13491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:33.599869 13491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:33.602459 13491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ae200670bbb549d9af34d78209a55a90: Sending DeleteTablet for 3 replicas of tablet 430914f416c34093913abbf47a1948ee
I20260811 15:02:33.603351 13916 tablet_service.cc:1514] Processing DeleteTablet for tablet 430914f416c34093913abbf47a1948ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:33 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:37460
I20260811 15:02:33.603339 13687 tablet_service.cc:1514] Processing DeleteTablet for tablet 430914f416c34093913abbf47a1948ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:33 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:33538
I20260811 15:02:33.603336 14123 tablet_service.cc:1514] Processing DeleteTablet for tablet 430914f416c34093913abbf47a1948ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:33 UTC) from {username='kudu', principal='kudu/127.11.225.126@KRBTEST.COM'} at 127.0.0.1:53380
I20260811 15:02:33.604138 14304 tablet_replica.cc:330] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: stopping tablet replica
I20260811 15:02:33.604503 14304 raft_consensus.cc:2229] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:02:33.604524 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13590
I20260811 15:02:33.603925 14303 tablet_replica.cc:330] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: stopping tablet replica
I20260811 15:02:33.617429 14303 raft_consensus.cc:2229] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:33.617872 14303 raft_consensus.cc:2258] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:33.618301 14304 raft_consensus.cc:2258] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:33.619786 14303 ts_tablet_manager.cc:1905] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:33.620078 14304 ts_tablet_manager.cc:1905] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:33.622699 14303 ts_tablet_manager.cc:1918] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:33.622809 14303 log.cc:1196] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/430914f416c34093913abbf47a1948ee
I20260811 15:02:33.623171 14303 ts_tablet_manager.cc:1939] T 430914f416c34093913abbf47a1948ee P b098c9e4c3b24528a6ad2dad78ca1fbf: Deleting consensus metadata
I20260811 15:02:33.623849 14304 ts_tablet_manager.cc:1918] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:33.624025 14304 log.cc:1196] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/430914f416c34093913abbf47a1948ee
I20260811 15:02:33.624466 14304 ts_tablet_manager.cc:1939] T 430914f416c34093913abbf47a1948ee P b897831c95244a1bb26358a6bdb829cc: Deleting consensus metadata
I20260811 15:02:33.624836 13474 catalog_manager.cc:4841] TS b098c9e4c3b24528a6ad2dad78ca1fbf (127.11.225.66:39157): tablet 430914f416c34093913abbf47a1948ee (table test-table [id=2e613f6ccfd64f32a6cae08c32265a3f]) successfully deleted
W20260811 15:02:33.625725 13471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:45355 (error 108)
I20260811 15:02:33.626228 13471 catalog_manager.cc:4841] TS b897831c95244a1bb26358a6bdb829cc (127.11.225.67:36065): tablet 430914f416c34093913abbf47a1948ee (table test-table [id=2e613f6ccfd64f32a6cae08c32265a3f]) successfully deleted
I20260811 15:02:33.626775 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13806
I20260811 15:02:33.626843 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.626517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45355 (local address 127.0.0.1:33540)
0811 15:02:33.626714 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:33.626772 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:45355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260811 15:02:33.632539 13471 catalog_manager.cc:4584] TS 6d682fe861904df282f030c99e82af0a (127.11.225.65:45355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 430914f416c34093913abbf47a1948ee: Network error: Client connection negotiation failed: client connection to 127.11.225.65:45355: connect: Connection refused (error 111)
I20260811 15:02:33.640862 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14024
I20260811 15:02:33.654347 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 13442
2026-08-11T15:02:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2649 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T15:02:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:33Z Disabled control of system clock
I20260811 15:02:33.694424 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35035
--webserver_interface=127.11.225.126
--webserver_port=0
--builtin_ntp_servers=127.11.225.84:43799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:35035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:33.809880 14316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:33.810135 14316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:33.810171 14316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:33.814208 14316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:33.814273 14316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:33.814288 14316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:33.814306 14316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:33.814321 14316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:33.819097 14316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:35035
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:35035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:33.820253 14316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:33.821694 14316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:33.830508 14327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:33.830518 14329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:33.830582 14316 server_base.cc:1034] running on GCE node
W20260811 15:02:33.830518 14326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:33.831368 14316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:33.832525 14316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:33.833756 14316 hybrid_clock.cc:648] HybridClock initialized: now 1786460553833742 us; error 29 us; skew 500 ppm
I20260811 15:02:33.835927 14316 webserver.cc:460] Webserver started at http://127.11.225.126:42063/ using document root <none> and password file <none>
I20260811 15:02:33.836587 14316 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:33.836704 14316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:33.836975 14316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:33.839361 14316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "3a5aa0f3c6004a078f579e99032bb3a2"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "5b2537567b413e9f3495fc2bef6868ff"
server_key_iv: "223cc38150f9057579d165bc1de4377a"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.840019 14316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "3a5aa0f3c6004a078f579e99032bb3a2"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "5b2537567b413e9f3495fc2bef6868ff"
server_key_iv: "223cc38150f9057579d165bc1de4377a"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.844192 14316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:02:33.847023 14336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:33.848403 14316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:02:33.848572 14316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "3a5aa0f3c6004a078f579e99032bb3a2"
format_stamp: "Formatted at 2026-08-11 15:02:33 on dist-test-slave-8hhm"
server_key: "5b2537567b413e9f3495fc2bef6868ff"
server_key_iv: "223cc38150f9057579d165bc1de4377a"
server_key_version: "encryptionkey@0"
I20260811 15:02:33.848704 14316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:33.871035 14316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:33.871920 14316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:33.872169 14316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:33.880048 14316 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:35035
I20260811 15:02:33.880070 14427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:35035 every 8 connection(s)
I20260811 15:02:33.881302 14316 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:33.884814 14428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:33.890733 14428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: Bootstrap starting.
I20260811 15:02:33.890986 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14316
I20260811 15:02:33.891126 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:33.891438 12165 external_mini_cluster.cc:1428] Setting key 710f1d7c516b14b51ebfd601c54242d5
I20260811 15:02:33.893728 14428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:33.894531 14428 log.cc:824] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:33.896545 14428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: No bootstrap required, opened a new log
I20260811 15:02:33.900519 14428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } }
I20260811 15:02:33.900753 14428 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:33.900837 14428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5aa0f3c6004a078f579e99032bb3a2, State: Initialized, Role: FOLLOWER
I20260811 15:02:33.901372 14428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } }
I20260811 15:02:33.901443 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:33.892894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46120 (local address 127.11.225.126:35035)
0811 15:02:33.893628 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:33.893643 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:33.893682 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:02:33.894416 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:33.894436 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:33.894920 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:33.895278 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:33.895732 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.896804 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.897806 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:33.898308 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:33.898493 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:33.899406 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:33.899411 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:33.899424 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:33.899826 (+ 402us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:33.899883 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:33.899903 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:33.900016 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:33.900175 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 15:02:33.900442 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":165,"threads_started":1}
I20260811 15:02:33.901508 14428 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:33.901587 14428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:33.901684 14428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:33.902695 14428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } }
I20260811 15:02:33.903071 14428 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a5aa0f3c6004a078f579e99032bb3a2; no voters:
I20260811 15:02:33.903411 14428 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:33.903589 14436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:33.903820 14436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [term 1 LEADER]: Becoming Leader. State: Replica: 3a5aa0f3c6004a078f579e99032bb3a2, State: Running, Role: LEADER
I20260811 15:02:33.904112 14436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } }
I20260811 15:02:33.904740 14428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:33.905284 14436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a5aa0f3c6004a078f579e99032bb3a2. Latest consensus state: current_term: 1 leader_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } } }
I20260811 15:02:33.905403 14436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:33.905807 14437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5aa0f3c6004a078f579e99032bb3a2" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 35035 } } }
I20260811 15:02:33.905946 14441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:33.905970 14437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:33.909273 14441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:33.915140 14441 catalog_manager.cc:1347] Generated new cluster ID: 52432c78278f4de3a74a5de8c725751a
I20260811 15:02:33.915223 14441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:33.931752 14441 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:33.932740 14441 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:33.942107 14441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: Generated new TSK 0
I20260811 15:02:33.942987 14441 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:33.947790 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.65:0
--local_ip_for_outbound_sockets=127.11.225.65
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--builtin_ntp_servers=127.11.225.84:43799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:02:34.065941 14463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:34.066201 14463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:34.066239 14463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:34.070650 14463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:34.070744 14463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:34.070835 14463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.65
I20260811 15:02:34.075834 14463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.225.65
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.65
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:34.076992 14463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:34.078449 14463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:34.088594 14470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:34.088667 14478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:34.088682 14463 server_base.cc:1034] running on GCE node
W20260811 15:02:34.088594 14474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:34.089388 14463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:34.090065 14463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:34.091413 14463 hybrid_clock.cc:648] HybridClock initialized: now 1786460554091388 us; error 27 us; skew 500 ppm
I20260811 15:02:34.093708 14463 webserver.cc:460] Webserver started at http://127.11.225.65:44817/ using document root <none> and password file <none>
I20260811 15:02:34.094269 14463 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:34.094329 14463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:34.094512 14463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:34.096585 14463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data/instance:
uuid: "455f77e8620d4f88894938fb1395a961"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "26170e13d7b8aad6e4cacf3b0a4f1ac2"
server_key_iv: "7baf953b63b669713a20785399e7b9a1"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.097095 14463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance:
uuid: "455f77e8620d4f88894938fb1395a961"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "26170e13d7b8aad6e4cacf3b0a4f1ac2"
server_key_iv: "7baf953b63b669713a20785399e7b9a1"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.100791 14463 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:34.103333 14487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.104799 14463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 15:02:34.104976 14463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal
uuid: "455f77e8620d4f88894938fb1395a961"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "26170e13d7b8aad6e4cacf3b0a4f1ac2"
server_key_iv: "7baf953b63b669713a20785399e7b9a1"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.105131 14463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:34.121575 14463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:34.122325 14463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:34.122530 14463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:34.123159 14463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:34.124296 14463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:34.124361 14463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.124413 14463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:34.124435 14463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.133272 14463 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.65:45675
I20260811 15:02:34.133428 14684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.65:45675 every 8 connection(s)
I20260811 15:02:34.134328 14463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/data/info.pb
I20260811 15:02:34.135937 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14463
I20260811 15:02:34.136085 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-0/wal/instance
I20260811 15:02:34.136408 12165 external_mini_cluster.cc:1428] Setting key 0c3d2439fd9280fccee0e511206530e8
I20260811 15:02:34.138485 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.66:0
--local_ip_for_outbound_sockets=127.11.225.66
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--builtin_ntp_servers=127.11.225.84:43799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:34.144801 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.136270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.65:56067 (local address 127.11.225.126:35035)
0811 15:02:34.136415 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.136419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.137705 (+ 1286us) server_negotiation.cc:407] Connection header received
0811 15:02:34.139307 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.139310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.139362 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.139439 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:34.140385 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.140945 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.142593 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.142848 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.142935 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.144322 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:34.144325 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:34.144327 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:34.144339 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:34.144357 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:34.144364 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:34.144424 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.144627 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.144682 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:02:34.146198 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.136784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35035 (local address 127.11.225.65:56067)
0811 15:02:34.137549 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.137603 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.139032 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.139610 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.139617 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.139700 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:34.140235 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.140248 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.141096 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.141099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.142458 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.142473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.143015 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.143022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.143284 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.143984 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:34.143989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:34.144061 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:34.144157 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:34.144456 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:34.144469 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:34.144478 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.144629 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.144973 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":141,"threads_started":1}
I20260811 15:02:34.147470 14687 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35035
I20260811 15:02:34.147742 14687 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:34.148298 14687 heartbeater.cc:511] Master 127.11.225.126:35035 requested a full tablet report, sending...
I20260811 15:02:34.149855 14365 ts_manager.cc:194] Registered new tserver with Master: 455f77e8620d4f88894938fb1395a961 (127.11.225.65:45675)
I20260811 15:02:34.151018 14365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.65:56067
W20260811 15:02:34.256196 14693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:34.256529 14693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:34.256625 14693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:34.260684 14693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:34.260802 14693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:34.260902 14693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.66
I20260811 15:02:34.265776 14693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.225.66
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.66
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:34.267067 14693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:34.268497 14693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:34.278470 14703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:34.278445 14708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:34.278445 14705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:34.278558 14693 server_base.cc:1034] running on GCE node
I20260811 15:02:34.279165 14693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:34.279815 14693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:34.280999 14693 hybrid_clock.cc:648] HybridClock initialized: now 1786460554280983 us; error 26 us; skew 500 ppm
I20260811 15:02:34.282896 14693 webserver.cc:460] Webserver started at http://127.11.225.66:40783/ using document root <none> and password file <none>
I20260811 15:02:34.283474 14693 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:34.283596 14693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:34.283874 14693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:34.286085 14693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data/instance:
uuid: "68c1e368e61a45a2ab2a2e92274b03bc"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "369f1432e3083950252929c12315cfb4"
server_key_iv: "34ae2ef6b689314dc5d5b1d970921e92"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.286679 14693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance:
uuid: "68c1e368e61a45a2ab2a2e92274b03bc"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "369f1432e3083950252929c12315cfb4"
server_key_iv: "34ae2ef6b689314dc5d5b1d970921e92"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.290328 14693 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:02:34.292706 14720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.293918 14693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:34.294059 14693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal
uuid: "68c1e368e61a45a2ab2a2e92274b03bc"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "369f1432e3083950252929c12315cfb4"
server_key_iv: "34ae2ef6b689314dc5d5b1d970921e92"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.294178 14693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:34.304621 14693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:34.305429 14693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:34.305644 14693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:34.306339 14693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:34.307389 14693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:34.307476 14693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.307555 14693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:34.307607 14693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.317091 14693 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.66:35195
I20260811 15:02:34.317145 14911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.66:35195 every 8 connection(s)
I20260811 15:02:34.318145 14693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/data/info.pb
I20260811 15:02:34.327049 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14693
I20260811 15:02:34.327215 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal/instance
I20260811 15:02:34.327556 12165 external_mini_cluster.cc:1428] Setting key 1cb53e18c922137a0f0303eb093fe59e
I20260811 15:02:34.328135 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.320126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:35917 (local address 127.11.225.126:35035)
0811 15:02:34.320286 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.320289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.321451 (+ 1162us) server_negotiation.cc:407] Connection header received
0811 15:02:34.323049 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.323053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.323113 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.323221 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:34.324195 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.324736 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.326011 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.326241 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.326359 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.327607 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:34.327611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:34.327614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:34.327628 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:34.327671 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:34.327683 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:34.327752 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.327927 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.327989 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 15:02:34.329195 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.320480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35035 (local address 127.11.225.66:35917)
0811 15:02:34.321206 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.321335 (+ 129us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.322777 (+ 1442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.323426 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.323433 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.323525 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:34.324034 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.324049 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.324867 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.324870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.325877 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.325887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.326403 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.326407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.326596 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.327281 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:34.327282 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:34.327364 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:34.327445 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:34.327753 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:34.327765 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:34.327774 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.327920 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.328224 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":126,"threads_started":1}
I20260811 15:02:34.329865 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.225.67:0
--local_ip_for_outbound_sockets=127.11.225.67
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--builtin_ntp_servers=127.11.225.84:43799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:02:34.330497 14912 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35035
I20260811 15:02:34.330734 14912 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:34.331272 14912 heartbeater.cc:511] Master 127.11.225.126:35035 requested a full tablet report, sending...
I20260811 15:02:34.332373 14365 ts_manager.cc:194] Registered new tserver with Master: 68c1e368e61a45a2ab2a2e92274b03bc (127.11.225.66:35195)
I20260811 15:02:34.333180 14365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.66:35917
W20260811 15:02:34.448757 14919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:34.449018 14919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:34.449064 14919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:34.453114 14919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:34.453171 14919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:34.453282 14919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.225.67
I20260811 15:02:34.458124 14919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:43799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.225.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.225.67
--webserver_port=0
--tserver_master_addrs=127.11.225.126:35035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.225.67
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:34.459182 14919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:34.460530 14919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:34.470374 14931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:34.470419 14929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:34.470620 14919 server_base.cc:1034] running on GCE node
W20260811 15:02:34.470692 14927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:34.471174 14919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:34.471843 14919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:34.473004 14919 hybrid_clock.cc:648] HybridClock initialized: now 1786460554472989 us; error 27 us; skew 500 ppm
I20260811 15:02:34.474910 14919 webserver.cc:460] Webserver started at http://127.11.225.67:42705/ using document root <none> and password file <none>
I20260811 15:02:34.475518 14919 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:34.475587 14919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:34.475875 14919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:34.478089 14919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data/instance:
uuid: "fb71d9f3c2b94d56a3885b271ade2125"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "40817d24170cea8fd5092fe327500307"
server_key_iv: "bf36f6fcf3cb68f3b95c609ed84b8787"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.478667 14919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance:
uuid: "fb71d9f3c2b94d56a3885b271ade2125"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "40817d24170cea8fd5092fe327500307"
server_key_iv: "bf36f6fcf3cb68f3b95c609ed84b8787"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.482400 14919 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:02:34.484862 14942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.486284 14919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:34.486433 14919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal
uuid: "fb71d9f3c2b94d56a3885b271ade2125"
format_stamp: "Formatted at 2026-08-11 15:02:34 on dist-test-slave-8hhm"
server_key: "40817d24170cea8fd5092fe327500307"
server_key_iv: "bf36f6fcf3cb68f3b95c609ed84b8787"
server_key_version: "encryptionkey@0"
I20260811 15:02:34.486558 14919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:34.503501 14919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:34.504256 14919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:34.504494 14919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:34.505154 14919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:02:34.506234 14919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:02:34.506306 14919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.506402 14919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:02:34.506484 14919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:34.516140 14919 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.67:34629
I20260811 15:02:34.516171 15136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.67:34629 every 8 connection(s)
I20260811 15:02:34.517094 14919 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/data/info.pb
I20260811 15:02:34.518141 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 14919
I20260811 15:02:34.518232 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal/instance
I20260811 15:02:34.518539 12165 external_mini_cluster.cc:1428] Setting key 6aab570e3d26c0a5ff2305c90d7a292d
I20260811 15:02:34.526701 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.519127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.67:38777 (local address 127.11.225.126:35035)
0811 15:02:34.519282 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.519286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.520467 (+ 1181us) server_negotiation.cc:407] Connection header received
0811 15:02:34.522017 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.522020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.522064 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.522134 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:34.523050 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.523580 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.524749 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.524975 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.525077 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.526279 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:34.526283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:34.526285 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:34.526297 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:34.526317 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:34.526325 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:34.526399 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.526538 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.526589 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:02:34.527590 15140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.519553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:35035 (local address 127.11.225.67:38777)
0811 15:02:34.520303 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.520357 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.521829 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.522305 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.522311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.522390 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:02:34.522893 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.522905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.523704 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.523706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.524610 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.524622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.525131 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.525133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.525343 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.526024 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:02:34.526026 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:02:34.526067 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:02:34.526129 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:02:34.526416 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:02:34.526423 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:02:34.526427 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.526521 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.526736 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":144,"threads_started":1}
I20260811 15:02:34.528781 15138 heartbeater.cc:347] Connected to a master server at 127.11.225.126:35035
I20260811 15:02:34.529032 15138 heartbeater.cc:464] Registering TS with master...
I20260811 15:02:34.529619 15138 heartbeater.cc:511] Master 127.11.225.126:35035 requested a full tablet report, sending...
I20260811 15:02:34.530647 14365 ts_manager.cc:194] Registered new tserver with Master: fb71d9f3c2b94d56a3885b271ade2125 (127.11.225.67:34629)
I20260811 15:02:34.531315 14365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.225.67:38777
I20260811 15:02:34.532735 12165 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:02:34.538394 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.534765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.11.225.126:35035)
0811 15:02:34.534894 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.534897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.535101 (+ 204us) server_negotiation.cc:407] Connection header received
0811 15:02:34.535191 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.535193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.535231 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.535298 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:34.535544 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.536040 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.536837 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.537061 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.537140 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.538038 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:34.538041 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:34.538043 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:34.538054 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:34.538072 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:34.538080 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:34.538139 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.538246 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.538293 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:02:34.541281 14361 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:02:34.544210 14361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:02:34.558770 15161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.552687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:34629 (local address 127.0.0.1:48316)
0811 15:02:34.553548 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.553563 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.553646 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.554449 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.554452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.554474 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:34.554600 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.554606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.555743 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.555749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.557141 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.557153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.558320 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.558327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.558427 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.558454 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.558503 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.558595 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":10,"thread_start_us":104,"threads_started":1}
I20260811 15:02:34.558758 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.552713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.11.225.65:45675)
0811 15:02:34.553775 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.553787 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.553812 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:02:34.553897 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.553902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.554126 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.554643 (+ 517us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:34.554786 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.555991 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.557426 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.557998 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.558143 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.558359 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.558461 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.558560 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":945,"thread_start_us":109,"threads_started":1}
I20260811 15:02:34.558773 15158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.552929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.66:35195 (local address 127.0.0.1:43852)
0811 15:02:34.553819 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.553832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.553905 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.554581 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.554584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.554599 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:34.554700 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.554706 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.556127 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.556130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.557390 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.557402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.558398 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.558401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.558471 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.558512 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.558553 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.558604 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":71,"thread_start_us":112,"threads_started":1}
I20260811 15:02:34.559238 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.553448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.11.225.66:35195)
0811 15:02:34.554158 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.554169 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.554194 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:02:34.554286 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.554291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.554455 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.554615 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:34.554821 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.556000 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.557531 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.558284 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.558680 (+ 396us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.558875 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.558935 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.559036 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":147,"threads_started":1}
I20260811 15:02:34.559389 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.552581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45675 (local address 127.0.0.1:53378)
0811 15:02:34.553255 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.553305 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.553434 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.554305 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.554311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.554335 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:34.554486 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.554511 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.556159 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.556162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.557289 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.557299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.558142 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.558145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.558267 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.558306 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.558423 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.558570 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":65,"thread_start_us":78,"threads_started":1}
I20260811 15:02:34.559798 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.553440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.11.225.67:34629)
0811 15:02:34.553910 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.553924 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.553948 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:02:34.554028 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.554034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.554283 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.554761 (+ 478us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:34.554899 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.555621 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.557300 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.558168 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.559213 (+ 1045us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.559414 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.559465 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.559594 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":172,"threads_started":1}
I20260811 15:02:34.562402 14576 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb372f13637420db84a9e3434e10824 (DEFAULT_TABLE table=test-table [id=f0aace3a344943a882862ba8e2b16af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:34.562485 14801 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb372f13637420db84a9e3434e10824 (DEFAULT_TABLE table=test-table [id=f0aace3a344943a882862ba8e2b16af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:34.562485 15026 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb372f13637420db84a9e3434e10824 (DEFAULT_TABLE table=test-table [id=f0aace3a344943a882862ba8e2b16af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:02:34.563485 14576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb372f13637420db84a9e3434e10824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:34.563566 15026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb372f13637420db84a9e3434e10824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:34.563566 14801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb372f13637420db84a9e3434e10824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:34.570134 15165 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Bootstrap starting.
I20260811 15:02:34.571543 15166 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Bootstrap starting.
I20260811 15:02:34.571547 15167 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Bootstrap starting.
I20260811 15:02:34.572623 15165 tablet_bootstrap.cc:654] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:34.573378 15166 tablet_bootstrap.cc:654] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:34.573544 15165 log.cc:824] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:34.573700 15167 tablet_bootstrap.cc:654] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:34.574183 15166 log.cc:824] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:34.574535 15167 log.cc:824] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:34.575987 15166 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: No bootstrap required, opened a new log
I20260811 15:02:34.576022 15165 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: No bootstrap required, opened a new log
I20260811 15:02:34.576196 15165 ts_tablet_manager.cc:1397] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:02:34.576196 15166 ts_tablet_manager.cc:1397] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 15:02:34.576354 15167 tablet_bootstrap.cc:492] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: No bootstrap required, opened a new log
I20260811 15:02:34.576550 15167 ts_tablet_manager.cc:1397] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:02:34.579756 15167 raft_consensus.cc:348] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.580001 15167 raft_consensus.cc:374] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:34.580068 15167 raft_consensus.cc:729] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb71d9f3c2b94d56a3885b271ade2125, State: Initialized, Role: FOLLOWER
I20260811 15:02:34.580546 15167 consensus_queue.cc:260] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.580602 15166 raft_consensus.cc:348] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.580602 15165 raft_consensus.cc:348] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.580850 15165 raft_consensus.cc:374] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:34.580850 15166 raft_consensus.cc:374] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:34.580907 15166 raft_consensus.cc:729] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68c1e368e61a45a2ab2a2e92274b03bc, State: Initialized, Role: FOLLOWER
I20260811 15:02:34.580915 15165 raft_consensus.cc:729] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 455f77e8620d4f88894938fb1395a961, State: Initialized, Role: FOLLOWER
I20260811 15:02:34.581404 15165 consensus_queue.cc:260] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.581404 15166 consensus_queue.cc:260] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.581677 15167 ts_tablet_manager.cc:1428] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 15:02:34.582044 15138 heartbeater.cc:503] Master 127.11.225.126:35035 was elected leader, sending a full tablet report...
I20260811 15:02:34.582355 15166 ts_tablet_manager.cc:1428] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:02:34.582355 15165 ts_tablet_manager.cc:1428] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:02:34.582690 14912 heartbeater.cc:503] Master 127.11.225.126:35035 was elected leader, sending a full tablet report...
I20260811 15:02:34.582690 14687 heartbeater.cc:503] Master 127.11.225.126:35035 was elected leader, sending a full tablet report...
I20260811 15:02:34.597565 15177 raft_consensus.cc:482] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:02:34.597774 15177 raft_consensus.cc:504] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.599072 15177 leader_election.cc:288] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 455f77e8620d4f88894938fb1395a961 (127.11.225.65:45675), fb71d9f3c2b94d56a3885b271ade2125 (127.11.225.67:34629)
I20260811 15:02:34.603240 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.599228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45675 (local address 127.11.225.66:32835)
0811 15:02:34.599545 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.599560 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.599671 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.600027 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.600039 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.600058 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:34.600185 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.600194 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.601131 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.601135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.602144 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.602154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.602799 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.602909 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.602934 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.603013 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.603084 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":20}
I20260811 15:02:34.603277 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.599405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:32835 (local address 127.11.225.65:45675)
0811 15:02:34.599688 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.599695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.599742 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:02:34.599828 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.599832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.599903 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.599990 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:34.600325 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.601013 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602267 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.602669 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602802 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.602854 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.603059 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.603158 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 15:02:34.603340 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.599441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.225.66:46505 (local address 127.11.225.67:34629)
0811 15:02:34.599960 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.599965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.600250 (+ 285us) server_negotiation.cc:407] Connection header received
0811 15:02:34.600370 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.600373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.600441 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.600528 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:02:34.600792 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.601336 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602377 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.602804 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602931 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.602980 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.603171 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.603233 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437}
I20260811 15:02:34.603349 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.599562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.67:34629 (local address 127.11.225.66:46505)
0811 15:02:34.600142 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.600164 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 15:02:34.600280 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:02:34.600547 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:02:34.600549 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:02:34.600568 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:02:34.600679 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.600685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.601450 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.601453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.602248 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:02:34.602257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.602935 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.602938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:02:34.603046 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.603065 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:02:34.603143 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 15:02:34.603193 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":1,"thread_start_us":132,"threads_started":1}
I20260811 15:02:34.603986 15059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb372f13637420db84a9e3434e10824" candidate_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb71d9f3c2b94d56a3885b271ade2125" is_pre_election: true
I20260811 15:02:34.604180 14614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb372f13637420db84a9e3434e10824" candidate_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455f77e8620d4f88894938fb1395a961" is_pre_election: true
I20260811 15:02:34.604341 15059 raft_consensus.cc:2454] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68c1e368e61a45a2ab2a2e92274b03bc in term 0.
I20260811 15:02:34.604481 14614 raft_consensus.cc:2454] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68c1e368e61a45a2ab2a2e92274b03bc in term 0.
I20260811 15:02:34.604921 14724 leader_election.cc:302] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 455f77e8620d4f88894938fb1395a961, 68c1e368e61a45a2ab2a2e92274b03bc, fb71d9f3c2b94d56a3885b271ade2125; no voters:
I20260811 15:02:34.605232 15177 raft_consensus.cc:2781] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:02:34.605320 15177 raft_consensus.cc:482] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:02:34.605374 15177 raft_consensus.cc:3037] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:34.606505 15177 raft_consensus.cc:504] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.606882 15177 leader_election.cc:288] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [CANDIDATE]: Term 1 election: Requested vote from peers 455f77e8620d4f88894938fb1395a961 (127.11.225.65:45675), fb71d9f3c2b94d56a3885b271ade2125 (127.11.225.67:34629)
I20260811 15:02:34.607204 15059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb372f13637420db84a9e3434e10824" candidate_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb71d9f3c2b94d56a3885b271ade2125"
I20260811 15:02:34.607203 14614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb372f13637420db84a9e3434e10824" candidate_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "455f77e8620d4f88894938fb1395a961"
I20260811 15:02:34.607331 14614 raft_consensus.cc:3037] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:34.607331 15059 raft_consensus.cc:3037] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:34.608594 15059 raft_consensus.cc:2454] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68c1e368e61a45a2ab2a2e92274b03bc in term 1.
I20260811 15:02:34.608600 14614 raft_consensus.cc:2454] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68c1e368e61a45a2ab2a2e92274b03bc in term 1.
I20260811 15:02:34.608942 14723 leader_election.cc:302] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 455f77e8620d4f88894938fb1395a961, 68c1e368e61a45a2ab2a2e92274b03bc; no voters:
I20260811 15:02:34.609120 15177 raft_consensus.cc:2781] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:34.609406 15177 raft_consensus.cc:686] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 1 LEADER]: Becoming Leader. State: Replica: 68c1e368e61a45a2ab2a2e92274b03bc, State: Running, Role: LEADER
I20260811 15:02:34.609772 15177 consensus_queue.cc:237] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } }
I20260811 15:02:34.613097 14361 catalog_manager.cc:5495] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 68c1e368e61a45a2ab2a2e92274b03bc (127.11.225.66). New cstate: current_term: 1 leader_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68c1e368e61a45a2ab2a2e92274b03bc" member_type: VOTER last_known_addr { host: "127.11.225.66" port: 35195 } health_report { overall_health: HEALTHY } } }
W20260811 15:02:34.635627 14688 tablet.cc:2369] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:02:34.637761 15163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.634085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43868 (local address 127.11.225.66:35195)
0811 15:02:34.634252 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:34.634256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:34.634270 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:02:34.634450 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:34.634454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:34.634539 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:34.634649 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:02:34.634891 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.635411 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.636284 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:34.636538 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:34.636619 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:34.636891 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:02:34.637353 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:02:34.637465 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:34.637528 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:02:34.637573 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 15:02:34.643713 14614 raft_consensus.cc:1261] T 0eb372f13637420db84a9e3434e10824 P 455f77e8620d4f88894938fb1395a961 [term 1 FOLLOWER]: Refusing update from remote peer 68c1e368e61a45a2ab2a2e92274b03bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:34.643718 15059 raft_consensus.cc:1261] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 1 FOLLOWER]: Refusing update from remote peer 68c1e368e61a45a2ab2a2e92274b03bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:02:34.644450 15180 consensus_queue.cc:1035] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "455f77e8620d4f88894938fb1395a961" member_type: VOTER last_known_addr { host: "127.11.225.65" port: 45675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:34.644651 15177 consensus_queue.cc:1035] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb71d9f3c2b94d56a3885b271ade2125" member_type: VOTER last_known_addr { host: "127.11.225.67" port: 34629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:02:34.655669 15186 mvcc.cc:205] Tried to move back new op lower bound from 7317342431813386240 to 7317342431684526080. Current Snapshot: MvccSnapshot[applied={T|T < 7317342431813386240}]
I20260811 15:02:34.660972 14365 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:34.661178 14365 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:02:34.663621 14365 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a5aa0f3c6004a078f579e99032bb3a2: Sending DeleteTablet for 3 replicas of tablet 0eb372f13637420db84a9e3434e10824
I20260811 15:02:34.664453 14576 tablet_service.cc:1514] Processing DeleteTablet for tablet 0eb372f13637420db84a9e3434e10824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:34 UTC) from {username='slave'} at 127.0.0.1:53378
I20260811 15:02:34.664494 15026 tablet_service.cc:1514] Processing DeleteTablet for tablet 0eb372f13637420db84a9e3434e10824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:34 UTC) from {username='slave'} at 127.0.0.1:48316
I20260811 15:02:34.664700 14801 tablet_service.cc:1514] Processing DeleteTablet for tablet 0eb372f13637420db84a9e3434e10824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:02:34 UTC) from {username='slave'} at 127.0.0.1:43852
I20260811 15:02:34.665041 15206 tablet_replica.cc:330] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: stopping tablet replica
I20260811 15:02:34.665380 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14463
I20260811 15:02:34.665406 15206 raft_consensus.cc:2229] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:02:34.668864 15206 raft_consensus.cc:2258] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:34.672555 15206 ts_tablet_manager.cc:1905] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:34.676671 15206 ts_tablet_manager.cc:1918] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:34.676817 15206 log.cc:1196] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-2/wal/wals/0eb372f13637420db84a9e3434e10824
I20260811 15:02:34.677258 15206 ts_tablet_manager.cc:1939] T 0eb372f13637420db84a9e3434e10824 P fb71d9f3c2b94d56a3885b271ade2125: Deleting consensus metadata
I20260811 15:02:34.678864 15209 tablet_replica.cc:330] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: stopping tablet replica
I20260811 15:02:34.679216 15209 raft_consensus.cc:2229] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:02:34.679685 15209 raft_consensus.cc:2258] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:02:34.679879 14340 catalog_manager.cc:4841] TS fb71d9f3c2b94d56a3885b271ade2125 (127.11.225.67:34629): tablet 0eb372f13637420db84a9e3434e10824 (table test-table [id=f0aace3a344943a882862ba8e2b16af8]) successfully deleted
I20260811 15:02:34.681326 15209 ts_tablet_manager.cc:1905] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:02:34.684638 15209 ts_tablet_manager.cc:1918] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:02:34.684757 15209 log.cc:1196] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Deleting WAL directory at /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460289406450-12165-0/minicluster-data/ts-1/wal/wals/0eb372f13637420db84a9e3434e10824
I20260811 15:02:34.685104 15209 ts_tablet_manager.cc:1939] T 0eb372f13637420db84a9e3434e10824 P 68c1e368e61a45a2ab2a2e92274b03bc: Deleting consensus metadata
I20260811 15:02:34.686650 14341 catalog_manager.cc:4841] TS 68c1e368e61a45a2ab2a2e92274b03bc (127.11.225.66:35195): tablet 0eb372f13637420db84a9e3434e10824 (table test-table [id=f0aace3a344943a882862ba8e2b16af8]) successfully deleted
W20260811 15:02:34.690171 14339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.225.65:45675 (error 108)
I20260811 15:02:34.691177 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14693
I20260811 15:02:34.691478 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:34.691087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.65:45675 (local address 127.0.0.1:53392)
0811 15:02:34.691268 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 15:02:34.691369 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.65:45675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 15:02:34.700150 14339 catalog_manager.cc:4584] TS 455f77e8620d4f88894938fb1395a961 (127.11.225.65:45675): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0eb372f13637420db84a9e3434e10824: Network error: Client connection negotiation failed: client connection to 127.11.225.65:45675: connect: Connection refused (error 111)
I20260811 15:02:34.711623 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14919
I20260811 15:02:34.726415 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 14316
2026-08-11T15:02:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1075 ms)
[----------] 6 tests from EncryptionPolicyTest (11068 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:34 dist-test-slave-8hhm krb5kdc[15215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:34 dist-test-slave-8hhm krb5kdc[15215](info): set up 2 sockets
Aug 11 15:02:34 dist-test-slave-8hhm krb5kdc[15215](info): commencing operation
krb5kdc: starting...
W20260811 15:02:36.026933 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:36.157765 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:36.274938 15246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:36.275205 15246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:36.275246 15246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:36.279246 15246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:36.279300 15246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:36.279318 15246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:36.279335 15246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:36.279378 15246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:36.284646 15246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:36.285688 15246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:36.286725 15246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:36.295464 15254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:36.295549 15259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:36.295564 15255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:36.295819 15246 server_base.cc:1034] running on GCE node
I20260811 15:02:36.296416 15246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:36.297559 15246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:36.298767 15246 hybrid_clock.cc:648] HybridClock initialized: now 1786460556298737 us; error 41 us; skew 500 ppm
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460556, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:36.301728 15246 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:36.302644 15246 webserver.cc:460] Webserver started at http://127.0.0.1:36651/ using document root <none> and password file <none>
I20260811 15:02:36.303253 15246 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:36.303350 15246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:36.303589 15246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:36.305795 15246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "4678a0016d8e4fb7868dfe2ed297a74a"
format_stamp: "Formatted at 2026-08-11 15:02:36 on dist-test-slave-8hhm"
server_key: "b1647be5117e1d8ac08358eb88bc2a1b"
server_key_iv: "74947f8f21d74b24f4da84e829031203"
server_key_version: "encryptionkey@0"
I20260811 15:02:36.306419 15246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "4678a0016d8e4fb7868dfe2ed297a74a"
format_stamp: "Formatted at 2026-08-11 15:02:36 on dist-test-slave-8hhm"
server_key: "b1647be5117e1d8ac08358eb88bc2a1b"
server_key_iv: "74947f8f21d74b24f4da84e829031203"
server_key_version: "encryptionkey@0"
I20260811 15:02:36.310248 15246 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:36.312739 15270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:36.314172 15246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:36.314335 15246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "4678a0016d8e4fb7868dfe2ed297a74a"
format_stamp: "Formatted at 2026-08-11 15:02:36 on dist-test-slave-8hhm"
server_key: "b1647be5117e1d8ac08358eb88bc2a1b"
server_key_iv: "74947f8f21d74b24f4da84e829031203"
server_key_version: "encryptionkey@0"
I20260811 15:02:36.314476 15246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:36.325398 15246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:36.328698 15246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:36.328912 15246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:36.336454 15246 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43239
I20260811 15:02:36.336460 15352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43239 every 8 connection(s)
I20260811 15:02:36.337546 15246 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:36.340384 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:36.344972 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15246
I20260811 15:02:36.345124 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:36.345454 12165 external_mini_cluster.cc:1428] Setting key 9b4e51cf3b5437a0eaa972c1a2960031
I20260811 15:02:36.346182 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: Bootstrap starting.
I20260811 15:02:36.348412 15353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:36.349406 15353 log.cc:824] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:36.351681 15353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: No bootstrap required, opened a new log
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:02:36.356176 15353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260811 15:02:36.356498 15353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:36.356602 15353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4678a0016d8e4fb7868dfe2ed297a74a, State: Initialized, Role: FOLLOWER
I20260811 15:02:36.357086 15353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260811 15:02:36.357259 15353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:36.357358 15353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:36.357484 15353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:36.358366 15353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260811 15:02:36.358716 15353 leader_election.cc:302] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4678a0016d8e4fb7868dfe2ed297a74a; no voters:
I20260811 15:02:36.359068 15353 leader_election.cc:288] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:36.359139 15359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:36.359345 15359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [term 1 LEADER]: Becoming Leader. State: Replica: 4678a0016d8e4fb7868dfe2ed297a74a, State: Running, Role: LEADER
I20260811 15:02:36.359689 15359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } }
I20260811 15:02:36.360378 15353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:36.361382 15362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } } }
I20260811 15:02:36.361529 15362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:36.361711 15356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:36.346934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41423 (local address 127.0.0.1:43239)
0811 15:02:36.347368 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:36.347386 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:36.347431 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:02:36.348050 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:36.348067 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:36.348395 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:36.348733 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:36.349709 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:36.350973 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:36.352227 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:36.352684 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:36.352810 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:36.355688 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:36.355693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:36.355706 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:36.355734 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:36.357847 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:36.358372 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:36.358378 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:36.358383 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:36.358560 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:36.358910 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:36.358913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:36.358915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:36.359433 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:36.360278 (+ 845us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:36.360417 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 15:02:36.360653 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":143,"threads_started":1}
I20260811 15:02:36.361863 15361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4678a0016d8e4fb7868dfe2ed297a74a. Latest consensus state: current_term: 1 leader_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4678a0016d8e4fb7868dfe2ed297a74a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43239 } } }
I20260811 15:02:36.361964 15361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:36.364816 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 15:02:36.365736 15388 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:36.365815 15388 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:36.365876 15373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:36.366762 15373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:36.373136 15373 catalog_manager.cc:1347] Generated new cluster ID: 42245ec4647e4dbbb2157484d15f11ae
I20260811 15:02:36.373235 15373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:36.375294 15356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:36.367087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55133 (local address 127.0.0.1:43239)
0811 15:02:36.367221 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:36.367226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:36.367237 (+ 11us) server_negotiation.cc:407] Connection header received
0811 15:02:36.367268 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:36.367271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:36.367312 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:36.367395 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:36.368047 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:36.368564 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:36.369435 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:36.369677 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:36.369788 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:36.371349 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:36.371353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:36.371356 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:36.371380 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:36.373324 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:36.373869 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:36.373873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:36.373875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:36.373962 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:36.374307 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:36.374311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:36.374312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:36.374484 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:36.374637 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:36.374915 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 15:02:36.375004 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:02:36.398499 15373 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:36.399454 15373 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:36.414192 15373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4678a0016d8e4fb7868dfe2ed297a74a: Generated new TSK 0
I20260811 15:02:36.415086 15373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:36.428284 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15246
W20260811 15:02:36.442781 15212 connection.cc:535] client connection to 127.0.0.1:43239 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43239): Connection reset by peer (error 104)
2026-08-11T15:02:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1697 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15407](info): set up 2 sockets
Aug 11 15:02:36 dist-test-slave-8hhm krb5kdc[15407](info): commencing operation
krb5kdc: starting...
W20260811 15:02:37.728659 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:37 dist-test-slave-8hhm krb5kdc[15407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:37.856657 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:37.973523 15431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:37.973817 15431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:37.973918 15431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:37.978425 15431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:37.978515 15431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:37.978556 15431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:37.978598 15431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:37.978641 15431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:37.983907 15431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:37.984963 15431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:37.986063 15431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:02:37.994942 15431 server_base.cc:1034] running on GCE node
W20260811 15:02:37.994895 15438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:37.994872 15440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:37.994894 15442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:37.995656 15431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:37.996754 15431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:37.997946 15431 hybrid_clock.cc:648] HybridClock initialized: now 1786460557997924 us; error 35 us; skew 500 ppm
Aug 11 15:02:37 dist-test-slave-8hhm krb5kdc[15407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460557, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:38.000730 15431 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:38.001710 15431 webserver.cc:460] Webserver started at http://127.0.0.1:35275/ using document root <none> and password file <none>
I20260811 15:02:38.002272 15431 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:38.002363 15431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:38.002609 15431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:38.004688 15431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "32331c5ffed942058e1ab6b131a4f986"
format_stamp: "Formatted at 2026-08-11 15:02:38 on dist-test-slave-8hhm"
server_key: "43c79216b8dcd9e1020104bcbda3ab5b"
server_key_iv: "d68c1a689281957cdaa9af60936597a8"
server_key_version: "encryptionkey@0"
I20260811 15:02:38.005340 15431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "32331c5ffed942058e1ab6b131a4f986"
format_stamp: "Formatted at 2026-08-11 15:02:38 on dist-test-slave-8hhm"
server_key: "43c79216b8dcd9e1020104bcbda3ab5b"
server_key_iv: "d68c1a689281957cdaa9af60936597a8"
server_key_version: "encryptionkey@0"
I20260811 15:02:38.008966 15431 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:38.011353 15452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:38.012571 15431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:38.012727 15431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "32331c5ffed942058e1ab6b131a4f986"
format_stamp: "Formatted at 2026-08-11 15:02:38 on dist-test-slave-8hhm"
server_key: "43c79216b8dcd9e1020104bcbda3ab5b"
server_key_iv: "d68c1a689281957cdaa9af60936597a8"
server_key_version: "encryptionkey@0"
I20260811 15:02:38.012836 15431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:38.037026 15431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:38.040037 15431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:38.040258 15431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:38.047890 15431 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36137
I20260811 15:02:38.047921 15537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36137 every 8 connection(s)
I20260811 15:02:38.048851 15431 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:38.051689 15538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:38.053776 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15431
I20260811 15:02:38.053934 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:38.054261 12165 external_mini_cluster.cc:1428] Setting key 69edb83c92f6f3cb282b2e9697898171
I20260811 15:02:38.058684 15538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986: Bootstrap starting.
I20260811 15:02:38.060914 15538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:38.061838 15538 log.cc:824] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:38.063537 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:38.055779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51663 (local address 127.0.0.1:36137)
0811 15:02:38.056240 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:38.056255 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:38.056291 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:38.057034 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:38.057060 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:38.057472 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:38.057840 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:38.058255 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:38.059277 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:38.060175 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:38.060646 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:38.060819 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:38.061789 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:38.061794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:38.061807 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:38.062271 (+ 464us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:38.062330 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:38.062353 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:38.062495 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:38.062687 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 15:02:38.062826 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":137,"threads_started":1}
I20260811 15:02:38.063946 15538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986: No bootstrap required, opened a new log
I20260811 15:02:38.066538 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:38.067943 15538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260811 15:02:38.068204 15538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:38.068295 15538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32331c5ffed942058e1ab6b131a4f986, State: Initialized, Role: FOLLOWER
I20260811 15:02:38.068804 15538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260811 15:02:38.068990 15538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:38.069090 15538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:38.069257 15538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:38.070425 15538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260811 15:02:38.070801 15538 leader_election.cc:302] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32331c5ffed942058e1ab6b131a4f986; no voters:
I20260811 15:02:38.071152 15538 leader_election.cc:288] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:38.071250 15550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:38.071496 15550 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [term 1 LEADER]: Becoming Leader. State: Replica: 32331c5ffed942058e1ab6b131a4f986, State: Running, Role: LEADER
I20260811 15:02:38.071857 15550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260811 15:02:38.072587 15538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:38.073132 15550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32331c5ffed942058e1ab6b131a4f986. Latest consensus state: current_term: 1 leader_uuid: "32331c5ffed942058e1ab6b131a4f986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } } }
I20260811 15:02:38.073288 15550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:38.073557 15543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:38.068666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40359 (local address 127.0.0.1:36137)
0811 15:02:38.068774 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:38.068778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:38.069131 (+ 353us) server_negotiation.cc:407] Connection header received
0811 15:02:38.069332 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:38.069336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:38.069390 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:38.069480 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:38.069685 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:38.070430 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:38.071430 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:38.071784 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:38.071889 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:38.072833 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:38.072837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:38.072839 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:38.072854 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:38.072885 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:38.072902 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:38.073001 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:38.073375 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 15:02:38.073417 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:02:38.073678 15559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:38.074124 15555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32331c5ffed942058e1ab6b131a4f986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32331c5ffed942058e1ab6b131a4f986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } } }
I20260811 15:02:38.074218 15555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:38.077520 15559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:38.083261 15559 catalog_manager.cc:1347] Generated new cluster ID: 2e5c4baaed954e36b2503917aa674776
I20260811 15:02:38.083321 15559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:38.089854 15559 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:38.090695 15559 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:38.103770 15559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32331c5ffed942058e1ab6b131a4f986: Generated new TSK 0
I20260811 15:02:38.104513 15559 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:38.108649 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15431
W20260811 15:02:38.122093 15402 connection.cc:535] client connection to 127.0.0.1:36137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36137): Connection reset by peer (error 104)
2026-08-11T15:02:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1679 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:38 dist-test-slave-8hhm krb5kdc[15584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:38 dist-test-slave-8hhm krb5kdc[15584](info): set up 2 sockets
Aug 11 15:02:38 dist-test-slave-8hhm krb5kdc[15584](info): commencing operation
krb5kdc: starting...
W20260811 15:02:39.410084 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:39 dist-test-slave-8hhm krb5kdc[15584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:39.541857 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:39.656821 15606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:39.657186 15606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:39.657291 15606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:39.661320 15606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:39.661412 15606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:39.661453 15606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:39.661512 15606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:39.661551 15606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:39.666723 15606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36511
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:39.667908 15606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:39.669004 15606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:39.677670 15617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:39.677713 15618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:39.677654 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:39.677873 15606 server_base.cc:1034] running on GCE node
I20260811 15:02:39.678774 15606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:39.679898 15606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:39.681106 15606 hybrid_clock.cc:648] HybridClock initialized: now 1786460559681070 us; error 47 us; skew 500 ppm
Aug 11 15:02:39 dist-test-slave-8hhm krb5kdc[15584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460559, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:39.687980 15606 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:39.688838 15606 webserver.cc:460] Webserver started at http://127.0.0.1:46361/ using document root <none> and password file <none>
I20260811 15:02:39.689436 15606 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:39.689500 15606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:39.689667 15606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:39.691629 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "1c70f56b933e444ba9e89687a6afe233"
format_stamp: "Formatted at 2026-08-11 15:02:39 on dist-test-slave-8hhm"
server_key: "21590e7955455f7284ccf77bc639c7dc"
server_key_iv: "74da1d4d4b92430d50a41acd5dbade16"
server_key_version: "encryptionkey@0"
I20260811 15:02:39.692170 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "1c70f56b933e444ba9e89687a6afe233"
format_stamp: "Formatted at 2026-08-11 15:02:39 on dist-test-slave-8hhm"
server_key: "21590e7955455f7284ccf77bc639c7dc"
server_key_iv: "74da1d4d4b92430d50a41acd5dbade16"
server_key_version: "encryptionkey@0"
I20260811 15:02:39.695809 15606 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 15:02:39.698241 15630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:39.699539 15606 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:39.699694 15606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "1c70f56b933e444ba9e89687a6afe233"
format_stamp: "Formatted at 2026-08-11 15:02:39 on dist-test-slave-8hhm"
server_key: "21590e7955455f7284ccf77bc639c7dc"
server_key_iv: "74da1d4d4b92430d50a41acd5dbade16"
server_key_version: "encryptionkey@0"
I20260811 15:02:39.699811 15606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:39.704463 15606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:39.707772 15606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:39.707980 15606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:39.715780 15606 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36511
I20260811 15:02:39.715792 15715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36511 every 8 connection(s)
I20260811 15:02:39.716738 15606 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:39.718906 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15606
I20260811 15:02:39.719067 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:39.719393 12165 external_mini_cluster.cc:1428] Setting key 0b7324537f6f7558aee6dd51ec13edf6
I20260811 15:02:39.719866 15718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:39.724596 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:39.720839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53105 (local address 127.0.0.1:36511)
0811 15:02:39.721258 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:39.721274 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:39.721307 (+ 33us) server_negotiation.cc:407] Connection header received
0811 15:02:39.721926 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:39.721943 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:39.722242 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:39.722540 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:39.723371 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:39.723376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:39.723387 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:39.723397 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:39.723449 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:39.723468 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:39.723583 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:39.723695 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 15:02:39.723862 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":138,"threads_started":1}
I20260811 15:02:39.726725 15718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: Bootstrap starting.
I20260811 15:02:39.727484 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:39.729491 15718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:39.730428 15718 log.cc:824] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:39.731503 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:39.729862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48271 (local address 127.0.0.1:36511)
0811 15:02:39.729991 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:39.729995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:39.730167 (+ 172us) server_negotiation.cc:407] Connection header received
0811 15:02:39.730247 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:39.730249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:39.730285 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:39.730374 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:39.731102 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:39.731104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:39.731106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:39.731116 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:39.731137 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:39.731146 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:39.731214 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:39.731347 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 15:02:39.731381 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:02:39.732702 15718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: No bootstrap required, opened a new log
I20260811 15:02:39.736152 15718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } }
I20260811 15:02:39.736346 15718 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:39.736421 15718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c70f56b933e444ba9e89687a6afe233, State: Initialized, Role: FOLLOWER
I20260811 15:02:39.736858 15718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } }
I20260811 15:02:39.736980 15718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:39.737025 15718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:39.737095 15718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:39.738155 15718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } }
I20260811 15:02:39.738467 15718 leader_election.cc:302] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c70f56b933e444ba9e89687a6afe233; no voters:
I20260811 15:02:39.738719 15718 leader_election.cc:288] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:39.738847 15732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:39.739105 15732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [term 1 LEADER]: Becoming Leader. State: Replica: 1c70f56b933e444ba9e89687a6afe233, State: Running, Role: LEADER
I20260811 15:02:39.739403 15732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } }
I20260811 15:02:39.739931 15718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:39.741109 15734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c70f56b933e444ba9e89687a6afe233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } } }
I20260811 15:02:39.741278 15734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:39.741321 15737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c70f56b933e444ba9e89687a6afe233. Latest consensus state: current_term: 1 leader_uuid: "1c70f56b933e444ba9e89687a6afe233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c70f56b933e444ba9e89687a6afe233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36511 } } }
I20260811 15:02:39.741413 15737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233 [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:39.744639 15761 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:39.744701 15761 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:39.744782 15749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:39.745539 15749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:39.750562 15749 catalog_manager.cc:1347] Generated new cluster ID: 8a9aaa7dc5f84370aa6274bf3bce3c9d
I20260811 15:02:39.750624 15749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:39.770886 15749 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:39.771210 15749 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:39.786638 15749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c70f56b933e444ba9e89687a6afe233: Generated new TSK 0
I20260811 15:02:39.787510 15749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:39.798988 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15606
2026-08-11T15:02:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1693 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:39 dist-test-slave-8hhm krb5kdc[15777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:39 dist-test-slave-8hhm krb5kdc[15777](info): set up 2 sockets
Aug 11 15:02:39 dist-test-slave-8hhm krb5kdc[15777](info): commencing operation
krb5kdc: starting...
W20260811 15:02:41.092824 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:41.223918 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:41.337040 15796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:41.337343 15796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:41.337389 15796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:41.341300 15796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:41.341358 15796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:41.341377 15796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:41.341394 15796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:41.341409 15796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:41.346720 15796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:41.347844 15796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:41.348855 15796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:41.357517 15807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:41.357558 15805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:41.357591 15810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:41.357753 15796 server_base.cc:1034] running on GCE node
I20260811 15:02:41.358567 15796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:41.359818 15796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:41.361039 15796 hybrid_clock.cc:648] HybridClock initialized: now 1786460561361012 us; error 46 us; skew 500 ppm
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460561, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:41.364065 15796 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:41.365109 15796 webserver.cc:460] Webserver started at http://127.0.0.1:35065/ using document root <none> and password file <none>
I20260811 15:02:41.365760 15796 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:41.365878 15796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:41.366138 15796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:41.368443 15796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "7c56d22beb99404485b2a38236e369aa"
format_stamp: "Formatted at 2026-08-11 15:02:41 on dist-test-slave-8hhm"
server_key: "e699c462ab3dd44df521e1af2e42e220"
server_key_iv: "8bf0bac7ed2f9dad923c078e1cfb5d69"
server_key_version: "encryptionkey@0"
I20260811 15:02:41.369092 15796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "7c56d22beb99404485b2a38236e369aa"
format_stamp: "Formatted at 2026-08-11 15:02:41 on dist-test-slave-8hhm"
server_key: "e699c462ab3dd44df521e1af2e42e220"
server_key_iv: "8bf0bac7ed2f9dad923c078e1cfb5d69"
server_key_version: "encryptionkey@0"
I20260811 15:02:41.373042 15796 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 15:02:41.375650 15820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:41.376853 15796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:02:41.377000 15796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "7c56d22beb99404485b2a38236e369aa"
format_stamp: "Formatted at 2026-08-11 15:02:41 on dist-test-slave-8hhm"
server_key: "e699c462ab3dd44df521e1af2e42e220"
server_key_iv: "8bf0bac7ed2f9dad923c078e1cfb5d69"
server_key_version: "encryptionkey@0"
I20260811 15:02:41.377117 15796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:41.387072 15796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:41.389822 15796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:41.390024 15796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:41.397539 15796 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43981
I20260811 15:02:41.397550 15907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43981 every 8 connection(s)
I20260811 15:02:41.398496 15796 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:41.400868 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15796
I20260811 15:02:41.401054 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:41.401387 12165 external_mini_cluster.cc:1428] Setting key ccb3ee488117fe67df0bcb850468c80a
I20260811 15:02:41.401520 15910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:41.408046 15910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa: Bootstrap starting.
I20260811 15:02:41.410388 15910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:41.411298 15910 log.cc:824] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:02:41.413800 15910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa: No bootstrap required, opened a new log
I20260811 15:02:41.417829 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:41.402852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53685 (local address 127.0.0.1:43981)
0811 15:02:41.403317 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:41.403332 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:41.403370 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:02:41.404363 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:41.404385 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:41.404773 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:41.405216 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:41.406224 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:41.407310 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:41.408341 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:41.408864 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:41.409063 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:41.412114 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:41.412124 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:41.412145 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:41.412187 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:41.414497 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:41.415009 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:41.415015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:41.415021 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:41.415162 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:41.415448 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:41.415453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:41.415456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:41.416007 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:41.416256 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:41.416477 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 15:02:41.416796 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":159,"threads_started":1}
I20260811 15:02:41.418663 15910 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } }
I20260811 15:02:41.418946 15910 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:41.419004 15910 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c56d22beb99404485b2a38236e369aa, State: Initialized, Role: FOLLOWER
I20260811 15:02:41.419453 15910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } }
I20260811 15:02:41.419596 15910 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:41.419687 15910 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:41.419811 15910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:41.420799 15910 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } }
I20260811 15:02:41.421142 15910 leader_election.cc:302] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c56d22beb99404485b2a38236e369aa; no voters:
I20260811 15:02:41.421247 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:41.421518 15910 leader_election.cc:288] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:41.421665 15918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:41.421949 15918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [term 1 LEADER]: Becoming Leader. State: Replica: 7c56d22beb99404485b2a38236e369aa, State: Running, Role: LEADER
I20260811 15:02:41.422338 15918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } }
I20260811 15:02:41.422883 15910 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:41.423854 15920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c56d22beb99404485b2a38236e369aa. Latest consensus state: current_term: 1 leader_uuid: "7c56d22beb99404485b2a38236e369aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } } }
I20260811 15:02:41.424018 15920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:41.424430 15921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c56d22beb99404485b2a38236e369aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c56d22beb99404485b2a38236e369aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43981 } } }
I20260811 15:02:41.424515 15940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:41.424552 15921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:41.428115 15940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:41.434041 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:41.423499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59499 (local address 127.0.0.1:43981)
0811 15:02:41.423658 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:41.423665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:41.424497 (+ 832us) server_negotiation.cc:407] Connection header received
0811 15:02:41.424712 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:41.424716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:41.424773 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:41.424833 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:41.425958 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:41.426713 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:41.427888 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:41.428249 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:41.428357 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:41.429976 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:41.429981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:41.429988 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:41.430011 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:41.431893 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:41.432405 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:41.432409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:41.432411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:41.432498 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:41.432824 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:41.432827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:41.432829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:41.433018 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:41.433162 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:41.433756 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 15:02:41.433865 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:02:41.435572 15940 catalog_manager.cc:1347] Generated new cluster ID: 1344e3f90d5b4fe8b1b0b541114f5297
I20260811 15:02:41.435652 15940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:41.448613 15940 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:41.450274 15940 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:41.455066 15940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c56d22beb99404485b2a38236e369aa: Generated new TSK 0
I20260811 15:02:41.455803 15940 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:41.460322 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15796
2026-08-11T15:02:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1663 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15964](info): set up 2 sockets
Aug 11 15:02:41 dist-test-slave-8hhm krb5kdc[15964](info): commencing operation
krb5kdc: starting...
W20260811 15:02:42.774626 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:42 dist-test-slave-8hhm krb5kdc[15964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:42.912056 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39215
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:43.029145 15984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:43.029552 15984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:43.029660 15984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:43.033759 15984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:43.033844 15984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:43.033879 15984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:43.033939 15984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:43.034003 15984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:43.039393 15984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:43.040566 15984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:43.041713 15984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:43.051005 15995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:43.051062 15992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:43.051007 15993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:43.051280 15984 server_base.cc:1034] running on GCE node
I20260811 15:02:43.052003 15984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:43.053180 15984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:43.054450 15984 hybrid_clock.cc:648] HybridClock initialized: now 1786460563054427 us; error 27 us; skew 500 ppm
Aug 11 15:02:43 dist-test-slave-8hhm krb5kdc[15964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460563, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:43.057533 15984 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:43.058486 15984 webserver.cc:460] Webserver started at http://127.0.0.1:37325/ using document root <none> and password file <none>
I20260811 15:02:43.059127 15984 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:43.059226 15984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:43.059471 15984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:43.061699 15984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "84940e49625f421293188cf89c1caca0"
format_stamp: "Formatted at 2026-08-11 15:02:43 on dist-test-slave-8hhm"
server_key: "46cf5ef220e12554d76ccab0b7071eab"
server_key_iv: "828845d4b4751f70a9815b84b52ac655"
server_key_version: "encryptionkey@0"
I20260811 15:02:43.062297 15984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "84940e49625f421293188cf89c1caca0"
format_stamp: "Formatted at 2026-08-11 15:02:43 on dist-test-slave-8hhm"
server_key: "46cf5ef220e12554d76ccab0b7071eab"
server_key_iv: "828845d4b4751f70a9815b84b52ac655"
server_key_version: "encryptionkey@0"
I20260811 15:02:43.066012 15984 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:02:43.068512 16007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:43.069892 15984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:43.070094 15984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "84940e49625f421293188cf89c1caca0"
format_stamp: "Formatted at 2026-08-11 15:02:43 on dist-test-slave-8hhm"
server_key: "46cf5ef220e12554d76ccab0b7071eab"
server_key_iv: "828845d4b4751f70a9815b84b52ac655"
server_key_version: "encryptionkey@0"
I20260811 15:02:43.070217 15984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:43.083549 15984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:43.087085 15984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:43.087311 15984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:43.095161 15984 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39215
I20260811 15:02:43.095224 16095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39215 every 8 connection(s)
I20260811 15:02:43.096235 15984 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:43.099156 16096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:43.099735 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 15984
I20260811 15:02:43.099901 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:43.100232 12165 external_mini_cluster.cc:1428] Setting key 6ce574d80acb0f7efd46e09a9d2d3481
I20260811 15:02:43.105430 16096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0: Bootstrap starting.
I20260811 15:02:43.107700 16096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:43.108531 16096 log.cc:824] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:43.109544 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:43.101707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37619 (local address 127.0.0.1:39215)
0811 15:02:43.102171 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:43.102186 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:43.102223 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:02:43.102897 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:43.102914 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:43.103262 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:43.103634 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:43.104060 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:43.105024 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:43.106088 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:43.106579 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:43.106757 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:43.107654 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:43.107659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:43.107672 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:43.108144 (+ 472us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:43.108204 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:43.108247 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:43.108361 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:43.108512 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 15:02:43.108742 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":131,"threads_started":1}
I20260811 15:02:43.110906 16096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0: No bootstrap required, opened a new log
I20260811 15:02:43.112696 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:43.115262 16096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260811 15:02:43.115607 16096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:43.115688 16096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84940e49625f421293188cf89c1caca0, State: Initialized, Role: FOLLOWER
I20260811 15:02:43.116197 16096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260811 15:02:43.116356 16096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:43.116417 16096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:43.116541 16096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:43.117849 16096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260811 15:02:43.118265 16096 leader_election.cc:302] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84940e49625f421293188cf89c1caca0; no voters:
I20260811 15:02:43.118707 16096 leader_election.cc:288] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:43.118952 16114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:43.119342 16114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [term 1 LEADER]: Becoming Leader. State: Replica: 84940e49625f421293188cf89c1caca0, State: Running, Role: LEADER
I20260811 15:02:43.119546 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:43.114895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57457 (local address 127.0.0.1:39215)
0811 15:02:43.115048 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:43.115060 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:43.115152 (+ 92us) server_negotiation.cc:407] Connection header received
0811 15:02:43.115269 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:43.115271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:43.115311 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:43.115377 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:43.115735 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:43.116493 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:43.117742 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:43.118027 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:43.118163 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:43.119086 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:43.119090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:43.119094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:43.119107 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:43.119136 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:43.119149 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:43.119193 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:43.119359 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 15:02:43.119414 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 15:02:43.119758 16114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } }
I20260811 15:02:43.120239 16096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:43.122272 16118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84940e49625f421293188cf89c1caca0. Latest consensus state: current_term: 1 leader_uuid: "84940e49625f421293188cf89c1caca0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } } }
I20260811 15:02:43.122292 16117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84940e49625f421293188cf89c1caca0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84940e49625f421293188cf89c1caca0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39215 } } }
I20260811 15:02:43.122449 16118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:43.122450 16117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:43.122845 16139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:43.126377 16139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:43.132004 16139 catalog_manager.cc:1347] Generated new cluster ID: caf0017fa01b477fa42e6973547cf996
I20260811 15:02:43.132092 16139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:43.143101 16139 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:43.144289 16139 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:43.155620 16139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84940e49625f421293188cf89c1caca0: Generated new TSK 0
I20260811 15:02:43.156416 16139 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:43.164876 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 15984
2026-08-11T15:02:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1699 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:43 dist-test-slave-8hhm krb5kdc[16148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:43 dist-test-slave-8hhm krb5kdc[16148](info): set up 2 sockets
Aug 11 15:02:43 dist-test-slave-8hhm krb5kdc[16148](info): commencing operation
krb5kdc: starting...
W20260811 15:02:44.460681 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:44 dist-test-slave-8hhm krb5kdc[16148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:44.604142 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45767
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:44.720405 16171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:44.720744 16171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:44.720832 16171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:44.724892 16171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:44.725005 16171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:44.725044 16171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:44.725081 16171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:44.725113 16171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:44.730610 16171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:44.731822 16171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:44.732925 16171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:44.741817 16183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:44.741820 16184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:44.741845 16187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:44.742270 16171 server_base.cc:1034] running on GCE node
I20260811 15:02:44.742831 16171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:44.743903 16171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:44.745108 16171 hybrid_clock.cc:648] HybridClock initialized: now 1786460564745097 us; error 36 us; skew 500 ppm
Aug 11 15:02:44 dist-test-slave-8hhm krb5kdc[16148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460564, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:44.753487 16171 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:44.754530 16171 webserver.cc:460] Webserver started at http://127.0.0.1:43149/ using document root <none> and password file <none>
I20260811 15:02:44.755141 16171 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:44.755239 16171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:44.755501 16171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:44.757704 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "dfb46c40799f48c89fc051ad3622b89d"
format_stamp: "Formatted at 2026-08-11 15:02:44 on dist-test-slave-8hhm"
server_key: "22a16a75cd992ffd74c927a550fdd38c"
server_key_iv: "4b8b40671336609046780e42af4a78cb"
server_key_version: "encryptionkey@0"
I20260811 15:02:44.758303 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "dfb46c40799f48c89fc051ad3622b89d"
format_stamp: "Formatted at 2026-08-11 15:02:44 on dist-test-slave-8hhm"
server_key: "22a16a75cd992ffd74c927a550fdd38c"
server_key_iv: "4b8b40671336609046780e42af4a78cb"
server_key_version: "encryptionkey@0"
I20260811 15:02:44.762272 16171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:44.764825 16200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:44.766103 16171 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:02:44.766269 16171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "dfb46c40799f48c89fc051ad3622b89d"
format_stamp: "Formatted at 2026-08-11 15:02:44 on dist-test-slave-8hhm"
server_key: "22a16a75cd992ffd74c927a550fdd38c"
server_key_iv: "4b8b40671336609046780e42af4a78cb"
server_key_version: "encryptionkey@0"
I20260811 15:02:44.766386 16171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:44.771155 16171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:44.774124 16171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:44.774333 16171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:44.781728 16171 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45767
I20260811 15:02:44.781752 16271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45767 every 8 connection(s)
I20260811 15:02:44.782748 16171 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:44.785627 16274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:44.791203 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: Bootstrap starting.
I20260811 15:02:44.791891 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16171
I20260811 15:02:44.792040 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:44.792328 12165 external_mini_cluster.cc:1428] Setting key 088b405fe7b305d75ee30d8f7ad7f9a6
I20260811 15:02:44.794708 16274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:44.795471 16274 log.cc:824] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:44.797704 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: No bootstrap required, opened a new log
I20260811 15:02:44.797830 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:44.793790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39991 (local address 127.0.0.1:45767)
0811 15:02:44.794211 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:44.794240 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:44.794278 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:02:44.795053 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:44.795074 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:44.795365 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:44.795726 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:44.796487 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:44.796492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:44.796503 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:44.796513 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:44.796565 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:44.796584 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:44.796683 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:44.796822 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 15:02:44.797009 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":118,"threads_started":1}
I20260811 15:02:44.800772 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:44.802228 16274 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } }
I20260811 15:02:44.802556 16274 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:44.802623 16274 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfb46c40799f48c89fc051ad3622b89d, State: Initialized, Role: FOLLOWER
I20260811 15:02:44.803154 16274 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } }
I20260811 15:02:44.803347 16274 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:44.803426 16274 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:44.803545 16274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:44.804823 16274 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } }
I20260811 15:02:44.805151 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:44.803305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60835 (local address 127.0.0.1:45767)
0811 15:02:44.803434 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:44.803439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:44.803695 (+ 256us) server_negotiation.cc:407] Connection header received
0811 15:02:44.803853 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:44.803856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:44.803890 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:44.803962 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:44.804704 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:44.804707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:44.804709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:44.804720 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:44.804747 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:44.804757 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:44.804842 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:44.805004 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 15:02:44.805045 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:02:44.805233 16274 leader_election.cc:302] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfb46c40799f48c89fc051ad3622b89d; no voters:
I20260811 15:02:44.805639 16274 leader_election.cc:288] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:44.805701 16290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:44.805930 16290 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [term 1 LEADER]: Becoming Leader. State: Replica: dfb46c40799f48c89fc051ad3622b89d, State: Running, Role: LEADER
I20260811 15:02:44.806283 16290 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } }
I20260811 15:02:44.807072 16274 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:44.809441 16293 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfb46c40799f48c89fc051ad3622b89d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } } }
I20260811 15:02:44.809624 16293 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:44.809583 16296 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfb46c40799f48c89fc051ad3622b89d. Latest consensus state: current_term: 1 leader_uuid: "dfb46c40799f48c89fc051ad3622b89d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfb46c40799f48c89fc051ad3622b89d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45767 } } }
I20260811 15:02:44.810055 16296 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:44.811975 16317 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:44.812107 16317 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:44.812214 16318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:44.813269 16318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:44.818851 16318 catalog_manager.cc:1347] Generated new cluster ID: 12dbe4646cf84975a4d80e1d633740cb
I20260811 15:02:44.818919 16318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:44.832763 16318 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:44.833127 16318 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:44.842342 16318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfb46c40799f48c89fc051ad3622b89d: Generated new TSK 0
I20260811 15:02:44.843179 16318 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:44.849504 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16171
2026-08-11T15:02:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1685 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:44 dist-test-slave-8hhm krb5kdc[16326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:44 dist-test-slave-8hhm krb5kdc[16326](info): set up 2 sockets
Aug 11 15:02:44 dist-test-slave-8hhm krb5kdc[16326](info): commencing operation
krb5kdc: starting...
W20260811 15:02:46.149680 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:46.286372 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45705
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:46.403191 16350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:46.403509 16350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:46.403605 16350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:46.407670 16350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:46.407763 16350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:46.407799 16350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:46.407857 16350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:46.407893 16350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:46.413197 16350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:46.414361 16350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:46.415482 16350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:46.424348 16359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:46.424361 16355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:46.424453 16350 server_base.cc:1034] running on GCE node
W20260811 15:02:46.424335 16357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:46.425194 16350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:46.426403 16350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:46.427598 16350 hybrid_clock.cc:648] HybridClock initialized: now 1786460566427581 us; error 27 us; skew 500 ppm
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460566, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:46.430634 16350 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:46.431594 16350 webserver.cc:460] Webserver started at http://127.0.0.1:46855/ using document root <none> and password file <none>
I20260811 15:02:46.432183 16350 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:46.432278 16350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:46.432521 16350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:46.434674 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "d58178b2673b40f59029ee94b7cd6d4d"
format_stamp: "Formatted at 2026-08-11 15:02:46 on dist-test-slave-8hhm"
server_key: "72b2f0777b3a693e6b0c02e585c08ce3"
server_key_iv: "663f06638539f668d12d88548dac2836"
server_key_version: "encryptionkey@0"
I20260811 15:02:46.435259 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "d58178b2673b40f59029ee94b7cd6d4d"
format_stamp: "Formatted at 2026-08-11 15:02:46 on dist-test-slave-8hhm"
server_key: "72b2f0777b3a693e6b0c02e585c08ce3"
server_key_iv: "663f06638539f668d12d88548dac2836"
server_key_version: "encryptionkey@0"
I20260811 15:02:46.439169 16350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:02:46.441715 16379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:46.442987 16350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:46.443146 16350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "d58178b2673b40f59029ee94b7cd6d4d"
format_stamp: "Formatted at 2026-08-11 15:02:46 on dist-test-slave-8hhm"
server_key: "72b2f0777b3a693e6b0c02e585c08ce3"
server_key_iv: "663f06638539f668d12d88548dac2836"
server_key_version: "encryptionkey@0"
I20260811 15:02:46.443262 16350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:46.457566 16350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:46.460367 16350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:46.460569 16350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:46.468070 16350 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45705
I20260811 15:02:46.468097 16461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45705 every 8 connection(s)
I20260811 15:02:46.469024 16350 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:46.471815 16463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:46.473814 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16350
I20260811 15:02:46.473984 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:46.474282 12165 external_mini_cluster.cc:1428] Setting key 5898da5d51104314412628cfafeaa6c9
I20260811 15:02:46.478994 16463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: Bootstrap starting.
I20260811 15:02:46.481659 16463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:46.482508 16463 log.cc:824] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:02:46.484812 16463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: No bootstrap required, opened a new log
I20260811 15:02:46.488806 16463 raft_consensus.cc:348] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } }
I20260811 15:02:46.489104 16463 raft_consensus.cc:374] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:46.489189 16463 raft_consensus.cc:729] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58178b2673b40f59029ee94b7cd6d4d, State: Initialized, Role: FOLLOWER
I20260811 15:02:46.489629 16463 consensus_queue.cc:260] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } }
I20260811 15:02:46.489786 16463 raft_consensus.cc:388] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:46.489878 16463 raft_consensus.cc:482] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:46.490000 16463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:46.490120 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:46.475700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:56965 (local address 127.0.0.1:45705)
0811 15:02:46.476141 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:46.476162 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:46.476205 (+ 43us) server_negotiation.cc:407] Connection header received
0811 15:02:46.477075 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:46.477101 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:46.477570 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:46.477947 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:46.478613 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:46.480070 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:46.481066 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:46.481806 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:46.481979 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:46.484988 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:46.484993 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:46.485006 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:46.485033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:46.486844 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:46.487408 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:46.487413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:46.487417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:46.487523 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:46.487891 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:46.487893 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:46.487894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:46.488263 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:46.488435 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:46.488798 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 15:02:46.489055 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":110,"threads_started":1}
I20260811 15:02:46.490945 16463 raft_consensus.cc:504] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } }
I20260811 15:02:46.491295 16463 leader_election.cc:302] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d58178b2673b40f59029ee94b7cd6d4d; no voters:
I20260811 15:02:46.491621 16463 leader_election.cc:288] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:46.491756 16469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:46.491976 16469 raft_consensus.cc:686] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [term 1 LEADER]: Becoming Leader. State: Replica: d58178b2673b40f59029ee94b7cd6d4d, State: Running, Role: LEADER
I20260811 15:02:46.492359 16469 consensus_queue.cc:237] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } }
I20260811 15:02:46.493031 16463 sys_catalog.cc:564] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:46.493475 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:46.494347 16471 sys_catalog.cc:455] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d58178b2673b40f59029ee94b7cd6d4d. Latest consensus state: current_term: 1 leader_uuid: "d58178b2673b40f59029ee94b7cd6d4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } } }
I20260811 15:02:46.494347 16470 sys_catalog.cc:455] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d58178b2673b40f59029ee94b7cd6d4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d58178b2673b40f59029ee94b7cd6d4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45705 } } }
I20260811 15:02:46.494491 16470 sys_catalog.cc:458] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:46.494491 16471 sys_catalog.cc:458] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:46.498226 16493 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:46.498318 16493 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:46.498428 16480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:46.499305 16480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:46.505887 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:46.495961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:57275 (local address 127.0.0.1:45705)
0811 15:02:46.496309 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:46.496314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:46.496582 (+ 268us) server_negotiation.cc:407] Connection header received
0811 15:02:46.496733 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:46.496736 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:46.496782 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:46.496859 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:46.497864 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:46.498634 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:46.499757 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:46.500118 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:46.500225 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:46.502053 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:46.502058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:46.502061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:46.502086 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:46.503833 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:46.504433 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:46.504439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:46.504442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:46.504546 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:46.504934 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:46.504937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:46.504939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:46.505165 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:46.505359 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:46.505632 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 15:02:46.505732 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281}
I20260811 15:02:46.506318 16480 catalog_manager.cc:1347] Generated new cluster ID: ad8c90d9bbe24686b09c1cadf123d667
I20260811 15:02:46.506386 16480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:46.534193 16480 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:46.535224 16480 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:46.546711 16480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d58178b2673b40f59029ee94b7cd6d4d: Generated new TSK 0
I20260811 15:02:46.547583 16480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:46.557585 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16350
W20260811 15:02:46.573319 16324 connection.cc:535] client connection to 127.0.0.1:45705 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45705): Connection reset by peer (error 104)
2026-08-11T15:02:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1708 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16504](info): set up 2 sockets
Aug 11 15:02:46 dist-test-slave-8hhm krb5kdc[16504](info): commencing operation
krb5kdc: starting...
W20260811 15:02:47.843075 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:47 dist-test-slave-8hhm krb5kdc[16504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:47.980136 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41333
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:48.097019 16527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:48.097431 16527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:48.097548 16527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:48.101794 16527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:48.101886 16527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:48.101930 16527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:48.101984 16527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:48.102018 16527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:48.111243 16527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:48.113005 16527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:48.114611 16527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:48.125396 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:48.125396 16539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:48.125396 16536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:48.125666 16527 server_base.cc:1034] running on GCE node
I20260811 15:02:48.126395 16527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:48.127581 16527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:48.128775 16527 hybrid_clock.cc:648] HybridClock initialized: now 1786460568128749 us; error 36 us; skew 500 ppm
Aug 11 15:02:48 dist-test-slave-8hhm krb5kdc[16504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460568, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:48.131655 16527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:48.132576 16527 webserver.cc:460] Webserver started at http://127.0.0.1:35153/ using document root <none> and password file <none>
I20260811 15:02:48.133180 16527 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:48.133349 16527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:48.133605 16527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:48.135713 16527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "6ec561ba980f4b7caf9d47a4033dc8cd"
format_stamp: "Formatted at 2026-08-11 15:02:48 on dist-test-slave-8hhm"
server_key: "2bb37c57116d21ef4049116fe3a3e596"
server_key_iv: "9577fbe68161850cc7084f287f06156a"
server_key_version: "encryptionkey@0"
I20260811 15:02:48.136308 16527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "6ec561ba980f4b7caf9d47a4033dc8cd"
format_stamp: "Formatted at 2026-08-11 15:02:48 on dist-test-slave-8hhm"
server_key: "2bb37c57116d21ef4049116fe3a3e596"
server_key_iv: "9577fbe68161850cc7084f287f06156a"
server_key_version: "encryptionkey@0"
I20260811 15:02:48.140095 16527 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 15:02:48.142673 16552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:48.143904 16527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:48.144068 16527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "6ec561ba980f4b7caf9d47a4033dc8cd"
format_stamp: "Formatted at 2026-08-11 15:02:48 on dist-test-slave-8hhm"
server_key: "2bb37c57116d21ef4049116fe3a3e596"
server_key_iv: "9577fbe68161850cc7084f287f06156a"
server_key_version: "encryptionkey@0"
I20260811 15:02:48.144183 16527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:48.160218 16527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:48.163391 16527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:48.163611 16527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:48.171882 16527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41333
I20260811 15:02:48.171903 16638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41333 every 8 connection(s)
I20260811 15:02:48.172878 16527 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:48.175735 16641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:48.177574 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16527
I20260811 15:02:48.177726 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:48.178054 12165 external_mini_cluster.cc:1428] Setting key 0199567d3b470bc56a633b45c989cfbc
I20260811 15:02:48.182420 16641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: Bootstrap starting.
I20260811 15:02:48.184674 16641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:48.185555 16641 log.cc:824] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:48.187368 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:48.179546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:35057 (local address 127.0.0.1:41333)
0811 15:02:48.180032 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:48.180048 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:48.180084 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:48.180741 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:48.180757 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:48.181097 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:48.181521 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:48.181924 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:48.182911 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:48.183827 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:48.184298 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:48.184473 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:48.185434 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:48.185439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:48.185452 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:48.185927 (+ 475us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:48.185997 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:48.186031 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:48.186176 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:48.186554 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 15:02:48.186672 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":132,"threads_started":1}
I20260811 15:02:48.187712 16641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: No bootstrap required, opened a new log
I20260811 15:02:48.190472 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:48.191771 16641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260811 15:02:48.192026 16641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:48.192088 16641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ec561ba980f4b7caf9d47a4033dc8cd, State: Initialized, Role: FOLLOWER
I20260811 15:02:48.192636 16641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260811 15:02:48.192817 16641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:48.192898 16641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:48.193019 16641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:48.194211 16641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260811 15:02:48.194597 16641 leader_election.cc:302] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ec561ba980f4b7caf9d47a4033dc8cd; no voters:
I20260811 15:02:48.194948 16641 leader_election.cc:288] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:48.195098 16659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:48.195370 16659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [term 1 LEADER]: Becoming Leader. State: Replica: 6ec561ba980f4b7caf9d47a4033dc8cd, State: Running, Role: LEADER
I20260811 15:02:48.195753 16659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260811 15:02:48.196398 16641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:48.197065 16661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ec561ba980f4b7caf9d47a4033dc8cd. Latest consensus state: current_term: 1 leader_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } } }
I20260811 15:02:48.197276 16661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:48.197635 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:48.192595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:54081 (local address 127.0.0.1:41333)
0811 15:02:48.192704 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:48.192708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:48.192970 (+ 262us) server_negotiation.cc:407] Connection header received
0811 15:02:48.193108 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:48.193111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:48.193161 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:48.193288 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:48.193559 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:48.194099 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:48.195318 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:48.195661 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:48.195765 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:48.196879 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:48.196883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:48.196886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:48.196898 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:48.196925 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:48.196939 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:48.197064 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:48.197444 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 15:02:48.197484 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 15:02:48.198305 16660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ec561ba980f4b7caf9d47a4033dc8cd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } } }
I20260811 15:02:48.198426 16660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd [sys.catalog]: This master's current role is: LEADER
W20260811 15:02:48.201742 16682 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:48.201836 16682 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:48.201943 16671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:48.202901 16671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:48.208796 16671 catalog_manager.cc:1347] Generated new cluster ID: 6afa536e4d094b9caf11e308f96a9b96
I20260811 15:02:48.208870 16671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:48.219019 16671 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:48.220230 16671 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:48.232293 16671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ec561ba980f4b7caf9d47a4033dc8cd: Generated new TSK 0
I20260811 15:02:48.233110 16671 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:48.239250 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16527
W20260811 15:02:48.256476 16500 connection.cc:535] client connection to 127.0.0.1:41333 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41333): Connection reset by peer (error 104)
2026-08-11T15:02:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1683 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:48 dist-test-slave-8hhm krb5kdc[16690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:48 dist-test-slave-8hhm krb5kdc[16690](info): set up 2 sockets
Aug 11 15:02:48 dist-test-slave-8hhm krb5kdc[16690](info): commencing operation
krb5kdc: starting...
W20260811 15:02:49.547178 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:49 dist-test-slave-8hhm krb5kdc[16690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:49.681120 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38185
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:49.799823 16707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:49.800096 16707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:49.800137 16707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:49.804036 16707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:49.804087 16707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:49.804106 16707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:49.804123 16707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:49.804138 16707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:49.809487 16707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:49.810570 16707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:49.811559 16707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:49.820582 16718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:49.820570 16727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:49.820550 16719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:49.820853 16707 server_base.cc:1034] running on GCE node
I20260811 15:02:49.821542 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:49.822635 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:49.823843 16707 hybrid_clock.cc:648] HybridClock initialized: now 1786460569823801 us; error 48 us; skew 500 ppm
Aug 11 15:02:49 dist-test-slave-8hhm krb5kdc[16690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460569, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:49.831200 16707 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:49.832190 16707 webserver.cc:460] Webserver started at http://127.0.0.1:36735/ using document root <none> and password file <none>
I20260811 15:02:49.832780 16707 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:49.832890 16707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:49.833146 16707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:49.835273 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "021287bee7da4c40a7dba8d319b89cb7"
format_stamp: "Formatted at 2026-08-11 15:02:49 on dist-test-slave-8hhm"
server_key: "2d0c3385c29565946109693801b35f23"
server_key_iv: "5964e9b299c600a4dd34e90356a460e5"
server_key_version: "encryptionkey@0"
I20260811 15:02:49.835860 16707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "021287bee7da4c40a7dba8d319b89cb7"
format_stamp: "Formatted at 2026-08-11 15:02:49 on dist-test-slave-8hhm"
server_key: "2d0c3385c29565946109693801b35f23"
server_key_iv: "5964e9b299c600a4dd34e90356a460e5"
server_key_version: "encryptionkey@0"
I20260811 15:02:49.839926 16707 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:02:49.842577 16743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:49.843886 16707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:02:49.844074 16707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "021287bee7da4c40a7dba8d319b89cb7"
format_stamp: "Formatted at 2026-08-11 15:02:49 on dist-test-slave-8hhm"
server_key: "2d0c3385c29565946109693801b35f23"
server_key_iv: "5964e9b299c600a4dd34e90356a460e5"
server_key_version: "encryptionkey@0"
I20260811 15:02:49.844202 16707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:49.849002 16707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:49.852442 16707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:49.852650 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:49.860204 16707 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38185
I20260811 15:02:49.860235 16839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38185 every 8 connection(s)
I20260811 15:02:49.861198 16707 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:49.863998 16841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:49.868728 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16707
I20260811 15:02:49.868883 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:49.869185 12165 external_mini_cluster.cc:1428] Setting key 072619afe8bf4fbe4b2343122b997509
I20260811 15:02:49.869979 16841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7: Bootstrap starting.
I20260811 15:02:49.872720 16841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:49.873708 16841 log.cc:824] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:49.875325 16846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:49.870757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:59415 (local address 127.0.0.1:38185)
0811 15:02:49.871235 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:49.871256 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:49.871303 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:02:49.872187 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:49.872212 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:49.872574 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:49.872979 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:49.873823 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:49.873829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:49.873845 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:49.873858 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:49.873922 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:49.873950 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:49.874071 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:49.874238 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 15:02:49.874425 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":118,"threads_started":1}
I20260811 15:02:49.876019 16841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7: No bootstrap required, opened a new log
I20260811 15:02:49.878168 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:49.880223 16841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } }
I20260811 15:02:49.880522 16841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:49.880613 16841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021287bee7da4c40a7dba8d319b89cb7, State: Initialized, Role: FOLLOWER
I20260811 15:02:49.881091 16841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } }
I20260811 15:02:49.881282 16841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:49.881381 16841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:49.881510 16841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:49.882045 16846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:49.880209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:52385 (local address 127.0.0.1:38185)
0811 15:02:49.880323 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:49.880327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:49.880511 (+ 184us) server_negotiation.cc:407] Connection header received
0811 15:02:49.880751 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:49.880754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:49.880791 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:49.880880 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:49.881694 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:49.881698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:49.881704 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:49.881720 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:49.881750 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:49.881764 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:49.881861 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:49.881896 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 15:02:49.881932 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 15:02:49.882694 16841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } }
I20260811 15:02:49.883066 16841 leader_election.cc:302] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 021287bee7da4c40a7dba8d319b89cb7; no voters:
I20260811 15:02:49.883330 16841 leader_election.cc:288] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:49.883486 16865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:49.883724 16865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 021287bee7da4c40a7dba8d319b89cb7, State: Running, Role: LEADER
I20260811 15:02:49.884083 16865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } }
I20260811 15:02:49.884577 16841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:49.886003 16868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "021287bee7da4c40a7dba8d319b89cb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } } }
I20260811 15:02:49.886013 16869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 021287bee7da4c40a7dba8d319b89cb7. Latest consensus state: current_term: 1 leader_uuid: "021287bee7da4c40a7dba8d319b89cb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "021287bee7da4c40a7dba8d319b89cb7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38185 } } }
I20260811 15:02:49.886133 16868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:49.886143 16869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:49.886525 16881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:49.889802 16881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:49.896055 16881 catalog_manager.cc:1347] Generated new cluster ID: 55bf5de30bbb4280aa98062a08ddfc13
I20260811 15:02:49.896214 16881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:49.915642 16881 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:49.915999 16881 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:49.923614 16881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 021287bee7da4c40a7dba8d319b89cb7: Generated new TSK 0
I20260811 15:02:49.924576 16881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:49.935721 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16707
2026-08-11T15:02:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1694 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:50 dist-test-slave-8hhm krb5kdc[16910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:50 dist-test-slave-8hhm krb5kdc[16910](info): set up 2 sockets
Aug 11 15:02:50 dist-test-slave-8hhm krb5kdc[16910](info): commencing operation
krb5kdc: starting...
W20260811 15:02:51.232806 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[16910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:51.369298 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:51.489384 16927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:51.489673 16927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:51.489717 16927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:51.493882 16927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:51.493958 16927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:51.493978 16927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:51.493995 16927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:51.494011 16927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:51.499686 16927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42171
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:51.500875 16927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:51.502032 16927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:51.511183 16936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:51.511394 16927 server_base.cc:1034] running on GCE node
W20260811 15:02:51.511191 16937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:51.511191 16941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:51.512213 16927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:51.513509 16927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:51.514721 16927 hybrid_clock.cc:648] HybridClock initialized: now 1786460571514691 us; error 42 us; skew 500 ppm
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[16910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460571, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:51.517833 16927 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:51.518826 16927 webserver.cc:460] Webserver started at http://127.0.0.1:34061/ using document root <none> and password file <none>
I20260811 15:02:51.519431 16927 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:51.519536 16927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:51.519793 16927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:51.522042 16927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "bdd8862a6e3f4fe0b14479d029856d6c"
format_stamp: "Formatted at 2026-08-11 15:02:51 on dist-test-slave-8hhm"
server_key: "b7101ad4a8853280e3b66ca619bb58ad"
server_key_iv: "739c0b3dc0d7ceed74ff59ea2f54ffc5"
server_key_version: "encryptionkey@0"
I20260811 15:02:51.522650 16927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "bdd8862a6e3f4fe0b14479d029856d6c"
format_stamp: "Formatted at 2026-08-11 15:02:51 on dist-test-slave-8hhm"
server_key: "b7101ad4a8853280e3b66ca619bb58ad"
server_key_iv: "739c0b3dc0d7ceed74ff59ea2f54ffc5"
server_key_version: "encryptionkey@0"
I20260811 15:02:51.526760 16927 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:02:51.529577 16949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:51.530957 16927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:02:51.531168 16927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "bdd8862a6e3f4fe0b14479d029856d6c"
format_stamp: "Formatted at 2026-08-11 15:02:51 on dist-test-slave-8hhm"
server_key: "b7101ad4a8853280e3b66ca619bb58ad"
server_key_iv: "739c0b3dc0d7ceed74ff59ea2f54ffc5"
server_key_version: "encryptionkey@0"
I20260811 15:02:51.531306 16927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:51.569576 16927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:51.573300 16927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:51.573531 16927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:51.580955 16927 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42171
I20260811 15:02:51.580972 17039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42171 every 8 connection(s)
I20260811 15:02:51.582005 16927 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:51.584893 17041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:51.587805 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 16927
I20260811 15:02:51.587983 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:51.588281 12165 external_mini_cluster.cc:1428] Setting key 9d3a30fe82af18aac99c468c33917287
I20260811 15:02:51.591017 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c: Bootstrap starting.
I20260811 15:02:51.593377 17041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:51.594137 17041 log.cc:824] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:51.596305 17041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c: No bootstrap required, opened a new log
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[16910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:02:51.601045 17041 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 15:02:51.601413 17041 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:51.601509 17041 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdd8862a6e3f4fe0b14479d029856d6c, State: Initialized, Role: FOLLOWER
I20260811 15:02:51.602023 17041 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 15:02:51.602159 17041 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:51.602272 17041 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:51.602384 17041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:51.603336 17041 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 15:02:51.603708 17041 leader_election.cc:302] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdd8862a6e3f4fe0b14479d029856d6c; no voters:
I20260811 15:02:51.604094 17041 leader_election.cc:288] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:51.604178 17051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:51.604398 17051 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [term 1 LEADER]: Becoming Leader. State: Replica: bdd8862a6e3f4fe0b14479d029856d6c, State: Running, Role: LEADER
I20260811 15:02:51.604768 17051 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } }
I20260811 15:02:51.605279 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:51.589769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:36465 (local address 127.0.0.1:42171)
0811 15:02:51.590274 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:51.590291 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:51.590327 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:51.590938 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:51.590955 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:51.591376 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:51.591723 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:51.592561 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:51.593709 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:51.594703 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:51.595345 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:51.595515 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:51.598848 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:51.598855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:51.598873 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:51.598912 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:51.601078 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:51.601938 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:51.601944 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:51.601949 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:51.602088 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:51.602644 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:51.602647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:51.602649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:51.603130 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:51.603410 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:51.603782 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 15:02:51.604078 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":177,"threads_started":1}
I20260811 15:02:51.605494 17041 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:51.606707 17058 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdd8862a6e3f4fe0b14479d029856d6c. Latest consensus state: current_term: 1 leader_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } } }
I20260811 15:02:51.606873 17058 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:51.607333 17072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:51.607275 17052 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdd8862a6e3f4fe0b14479d029856d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42171 } } }
I20260811 15:02:51.607450 17052 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:51.609110 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:51.610875 17072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:51.617733 17072 catalog_manager.cc:1347] Generated new cluster ID: cc8f81cb4bbc4603b12e0f04a4daf1b9
I20260811 15:02:51.617813 17072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:51.628161 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:51.611341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:50211 (local address 127.0.0.1:42171)
0811 15:02:51.611466 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:51.611470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:51.611922 (+ 452us) server_negotiation.cc:407] Connection header received
0811 15:02:51.612006 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:51.612009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:51.612065 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:51.612165 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:51.612804 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:51.613675 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:51.614806 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:51.615040 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:51.615155 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:51.616690 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:51.616693 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:51.616695 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:51.616717 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:51.625969 (+ 9252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:51.626635 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:51.626639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:51.626641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:51.626754 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:51.627175 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:51.627179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:51.627181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:51.627423 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:51.627597 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:51.627882 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 15:02:51.627986 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:02:51.629185 17072 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:51.630151 17072 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:51.638808 17072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdd8862a6e3f4fe0b14479d029856d6c: Generated new TSK 0
I20260811 15:02:51.639685 17072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:51.650846 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 16927
W20260811 15:02:51.669659 16905 connection.cc:535] client connection to 127.0.0.1:42171 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42171): Connection reset by peer (error 104)
2026-08-11T15:02:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1718 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[17100](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[17100](info): set up 2 sockets
Aug 11 15:02:51 dist-test-slave-8hhm krb5kdc[17100](info): commencing operation
krb5kdc: starting...
W20260811 15:02:52.967311 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:53 dist-test-slave-8hhm krb5kdc[17100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:53.101146 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42415
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:53.221910 17122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:53.222222 17122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:53.222301 17122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:53.227008 17122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:53.227083 17122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:53.227104 17122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:53.227121 17122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:53.227159 17122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:53.232661 17122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42415
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:53.233850 17122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:53.234889 17122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:02:53.243872 17122 server_base.cc:1034] running on GCE node
W20260811 15:02:53.243846 17129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:53.243846 17130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:53.243894 17132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:53.244788 17122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:53.246011 17122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:53.247177 17122 hybrid_clock.cc:648] HybridClock initialized: now 1786460573247136 us; error 56 us; skew 500 ppm
Aug 11 15:02:53 dist-test-slave-8hhm krb5kdc[17100](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460573, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:53.250108 17122 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:53.250969 17122 webserver.cc:460] Webserver started at http://127.0.0.1:46377/ using document root <none> and password file <none>
I20260811 15:02:53.251506 17122 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:53.251569 17122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:53.251758 17122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:53.253919 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "acc693e1c3674c95b905621cbf087b6e"
format_stamp: "Formatted at 2026-08-11 15:02:53 on dist-test-slave-8hhm"
server_key: "0ce4445fa4d303fd3ab72a5b2489596c"
server_key_iv: "aa1ffbd1f919173215fa51ad5ef654b1"
server_key_version: "encryptionkey@0"
I20260811 15:02:53.254444 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "acc693e1c3674c95b905621cbf087b6e"
format_stamp: "Formatted at 2026-08-11 15:02:53 on dist-test-slave-8hhm"
server_key: "0ce4445fa4d303fd3ab72a5b2489596c"
server_key_iv: "aa1ffbd1f919173215fa51ad5ef654b1"
server_key_version: "encryptionkey@0"
I20260811 15:02:53.258260 17122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:02:53.260805 17144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:53.262223 17122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:02:53.262380 17122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "acc693e1c3674c95b905621cbf087b6e"
format_stamp: "Formatted at 2026-08-11 15:02:53 on dist-test-slave-8hhm"
server_key: "0ce4445fa4d303fd3ab72a5b2489596c"
server_key_iv: "aa1ffbd1f919173215fa51ad5ef654b1"
server_key_version: "encryptionkey@0"
I20260811 15:02:53.262496 17122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:53.303934 17122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:53.307499 17122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:53.307732 17122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:53.315544 17122 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42415
I20260811 15:02:53.315582 17243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42415 every 8 connection(s)
I20260811 15:02:53.316591 17122 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:53.319686 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17122
I20260811 15:02:53.319864 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:53.320184 17246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:53.320243 12165 external_mini_cluster.cc:1428] Setting key 26ce6e758ef929d7109d00710ea37346
I20260811 15:02:53.327212 17246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e: Bootstrap starting.
I20260811 15:02:53.329793 17250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:53.321841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:36321 (local address 127.0.0.1:42415)
0811 15:02:53.322362 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:53.322378 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:53.322414 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:53.323274 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:53.323294 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:53.323636 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:53.323977 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:53.324392 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:53.325448 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:53.326367 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:53.326869 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:53.327047 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:53.328018 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:53.328023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:53.328037 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:53.328434 (+ 397us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:53.328489 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:53.328511 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:53.328654 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:53.328849 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 15:02:53.328989 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":180,"threads_started":1}
I20260811 15:02:53.329902 17246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:53.330706 17246 log.cc:824] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:53.332851 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:53.333283 17246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e: No bootstrap required, opened a new log
I20260811 15:02:53.337453 17246 raft_consensus.cc:348] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } }
I20260811 15:02:53.337786 17246 raft_consensus.cc:374] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:53.337881 17246 raft_consensus.cc:729] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc693e1c3674c95b905621cbf087b6e, State: Initialized, Role: FOLLOWER
I20260811 15:02:53.338481 17246 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } }
I20260811 15:02:53.338670 17246 raft_consensus.cc:388] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:53.338814 17246 raft_consensus.cc:482] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:53.338955 17246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:53.339617 17250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:53.335038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:36647 (local address 127.0.0.1:42415)
0811 15:02:53.335188 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:53.335192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:53.335405 (+ 213us) server_negotiation.cc:407] Connection header received
0811 15:02:53.335542 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:53.335544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:53.335582 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:53.335646 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:53.336024 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:53.336499 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:53.337719 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:53.338077 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:53.338165 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:53.339132 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:53.339136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:53.339138 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:53.339151 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:53.339191 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:53.339202 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:53.339300 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:53.339444 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 15:02:53.339478 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:02:53.340271 17246 raft_consensus.cc:504] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } }
I20260811 15:02:53.340700 17246 leader_election.cc:302] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acc693e1c3674c95b905621cbf087b6e; no voters:
I20260811 15:02:53.341073 17246 leader_election.cc:288] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:53.341164 17263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:53.341430 17263 raft_consensus.cc:686] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [term 1 LEADER]: Becoming Leader. State: Replica: acc693e1c3674c95b905621cbf087b6e, State: Running, Role: LEADER
I20260811 15:02:53.341780 17263 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } }
I20260811 15:02:53.342446 17246 sys_catalog.cc:564] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:53.343706 17265 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc693e1c3674c95b905621cbf087b6e. Latest consensus state: current_term: 1 leader_uuid: "acc693e1c3674c95b905621cbf087b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } } }
I20260811 15:02:53.343706 17264 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acc693e1c3674c95b905621cbf087b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc693e1c3674c95b905621cbf087b6e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42415 } } }
I20260811 15:02:53.343860 17265 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:53.343860 17264 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:53.344291 17278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:53.347497 17278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:53.353534 17278 catalog_manager.cc:1347] Generated new cluster ID: 4a534eb9220d439f8b8e0aeff211f7f6
I20260811 15:02:53.353610 17278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:53.376402 17278 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:53.377753 17278 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:53.385242 17278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acc693e1c3674c95b905621cbf087b6e: Generated new TSK 0
I20260811 15:02:53.386103 17278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:53.396572 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17122
W20260811 15:02:53.412135 17096 connection.cc:535] client connection to 127.0.0.1:42415 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42415): Connection reset by peer (error 104)
2026-08-11T15:02:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1742 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:53 dist-test-slave-8hhm krb5kdc[17293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:53 dist-test-slave-8hhm krb5kdc[17293](info): set up 2 sockets
Aug 11 15:02:53 dist-test-slave-8hhm krb5kdc[17293](info): commencing operation
krb5kdc: starting...
W20260811 15:02:54.764820 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:54 dist-test-slave-8hhm krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:02:54.908572 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36581
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:55.026396 17314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:55.026683 17314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:55.026726 17314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:55.030807 17314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:55.030867 17314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:55.030885 17314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:55.030901 17314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:55.030915 17314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:55.036311 17314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:55.037393 17314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:55.038426 17314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:55.047075 17325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:55.047075 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:55.047259 17314 server_base.cc:1034] running on GCE node
W20260811 15:02:55.047569 17327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:55.048213 17314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:55.049463 17314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:55.050668 17314 hybrid_clock.cc:648] HybridClock initialized: now 1786460575050648 us; error 32 us; skew 500 ppm
Aug 11 15:02:55 dist-test-slave-8hhm krb5kdc[17293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460575, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:55.058015 17314 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:02:55.059158 17314 webserver.cc:460] Webserver started at http://127.0.0.1:33657/ using document root <none> and password file <none>
I20260811 15:02:55.059794 17314 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:55.059890 17314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:55.060151 17314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:55.062444 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "10d2d373c876426b8f2629a5e786bd1b"
format_stamp: "Formatted at 2026-08-11 15:02:55 on dist-test-slave-8hhm"
server_key: "c84a88be58f2938f390e93ae28b71f46"
server_key_iv: "d11600a5b318fbe7afe30b420c15da90"
server_key_version: "encryptionkey@0"
I20260811 15:02:55.063077 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "10d2d373c876426b8f2629a5e786bd1b"
format_stamp: "Formatted at 2026-08-11 15:02:55 on dist-test-slave-8hhm"
server_key: "c84a88be58f2938f390e93ae28b71f46"
server_key_iv: "d11600a5b318fbe7afe30b420c15da90"
server_key_version: "encryptionkey@0"
I20260811 15:02:55.067231 17314 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:55.069805 17341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:55.071270 17314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:55.071420 17314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "10d2d373c876426b8f2629a5e786bd1b"
format_stamp: "Formatted at 2026-08-11 15:02:55 on dist-test-slave-8hhm"
server_key: "c84a88be58f2938f390e93ae28b71f46"
server_key_iv: "d11600a5b318fbe7afe30b420c15da90"
server_key_version: "encryptionkey@0"
I20260811 15:02:55.071543 17314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:55.076484 17314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:55.079798 17314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:55.080016 17314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:55.087579 17314 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36581
I20260811 15:02:55.087610 17429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36581 every 8 connection(s)
I20260811 15:02:55.088557 17314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:55.091475 17430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:55.096809 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17314
I20260811 15:02:55.096961 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:55.097335 12165 external_mini_cluster.cc:1428] Setting key e260a29472d8b9a51324b984029d356c
I20260811 15:02:55.097394 17430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b: Bootstrap starting.
I20260811 15:02:55.099995 17430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:55.100761 17430 log.cc:824] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:55.102623 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:55.098766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:40809 (local address 127.0.0.1:36581)
0811 15:02:55.099223 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:55.099244 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:55.099280 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:02:55.099925 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:55.099943 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:55.100286 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:55.100624 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:55.101432 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:55.101437 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:55.101461 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:55.101471 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:55.101520 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:55.101541 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:55.101657 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:55.101768 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 15:02:55.101936 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":142,"threads_started":1}
I20260811 15:02:55.102929 17430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b: No bootstrap required, opened a new log
I20260811 15:02:55.105521 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:55.106904 17430 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260811 15:02:55.107165 17430 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:55.107254 17430 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d2d373c876426b8f2629a5e786bd1b, State: Initialized, Role: FOLLOWER
I20260811 15:02:55.107758 17430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260811 15:02:55.107933 17430 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:55.108016 17430 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:55.108137 17430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:55.109400 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:55.107636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.202:38997 (local address 127.0.0.1:36581)
0811 15:02:55.107766 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:55.107771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:55.107968 (+ 197us) server_negotiation.cc:407] Connection header received
0811 15:02:55.108125 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:55.108127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:55.108167 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:55.108260 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:55.108929 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:55.108932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:55.108934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:55.108943 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:55.108966 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:55.108975 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:55.109049 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:55.109188 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 15:02:55.109268 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:02:55.109549 17430 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260811 15:02:55.109928 17430 leader_election.cc:302] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d2d373c876426b8f2629a5e786bd1b; no voters:
I20260811 15:02:55.110277 17430 leader_election.cc:288] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:55.110342 17459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:55.110522 17459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [term 1 LEADER]: Becoming Leader. State: Replica: 10d2d373c876426b8f2629a5e786bd1b, State: Running, Role: LEADER
I20260811 15:02:55.110831 17459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260811 15:02:55.111610 17430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:55.112722 17461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d2d373c876426b8f2629a5e786bd1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } } }
I20260811 15:02:55.112855 17461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:55.113152 17460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d2d373c876426b8f2629a5e786bd1b. Latest consensus state: current_term: 1 leader_uuid: "10d2d373c876426b8f2629a5e786bd1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d2d373c876426b8f2629a5e786bd1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } } }
I20260811 15:02:55.113273 17460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:55.113389 17477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:55.116595 17477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:55.122730 17477 catalog_manager.cc:1347] Generated new cluster ID: f873bf82f7ce45a1b4c72cac7f3658f3
I20260811 15:02:55.122828 17477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:55.144980 17477 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:55.145390 17477 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:55.161787 17477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d2d373c876426b8f2629a5e786bd1b: Generated new TSK 0
I20260811 15:02:55.162730 17477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:55.169790 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17314
2026-08-11T15:02:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1773 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:55 dist-test-slave-8hhm krb5kdc[17494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:55 dist-test-slave-8hhm krb5kdc[17494](info): set up 2 sockets
Aug 11 15:02:55 dist-test-slave-8hhm krb5kdc[17494](info): commencing operation
krb5kdc: starting...
W20260811 15:02:56.468070 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:02:56.604568 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:39409
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:39409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:56.722100 17514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:56.722520 17514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:56.722633 17514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:56.726766 17514 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:56.726871 17514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:56.726910 17514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:56.726948 17514 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:56.726982 17514 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:56.732503 17514 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:39409
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:39409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:56.733707 17514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:56.734795 17514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:56.744026 17526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:56.744132 17520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:56.744081 17519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:56.744339 17514 server_base.cc:1034] running on GCE node
I20260811 15:02:56.745159 17514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:56.746584 17514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:56.747800 17514 hybrid_clock.cc:648] HybridClock initialized: now 1786460576747766 us; error 45 us; skew 500 ppm
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460576, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:56.750844 17514 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:56.751859 17514 webserver.cc:460] Webserver started at http://127.11.225.126:36961/ using document root <none> and password file <none>
I20260811 15:02:56.752391 17514 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:56.752450 17514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:56.752630 17514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:56.754750 17514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "bf187f6a88244502aa592433c496f8ff"
format_stamp: "Formatted at 2026-08-11 15:02:56 on dist-test-slave-8hhm"
server_key: "93f50fb8621c8c93dd4244bcd8a720ec"
server_key_iv: "abeae763ade1cdaee7dec35189466b30"
server_key_version: "encryptionkey@0"
I20260811 15:02:56.755288 17514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "bf187f6a88244502aa592433c496f8ff"
format_stamp: "Formatted at 2026-08-11 15:02:56 on dist-test-slave-8hhm"
server_key: "93f50fb8621c8c93dd4244bcd8a720ec"
server_key_iv: "abeae763ade1cdaee7dec35189466b30"
server_key_version: "encryptionkey@0"
I20260811 15:02:56.759176 17514 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:02:56.761859 17542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:56.763248 17514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:02:56.763391 17514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "bf187f6a88244502aa592433c496f8ff"
format_stamp: "Formatted at 2026-08-11 15:02:56 on dist-test-slave-8hhm"
server_key: "93f50fb8621c8c93dd4244bcd8a720ec"
server_key_iv: "abeae763ade1cdaee7dec35189466b30"
server_key_version: "encryptionkey@0"
I20260811 15:02:56.763487 17514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:56.794836 17514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:56.798229 17514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:56.798401 17514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:56.805786 17514 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:39409
I20260811 15:02:56.805812 17636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:39409 every 8 connection(s)
I20260811 15:02:56.806872 17514 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:56.809871 17637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:56.812268 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17514
I20260811 15:02:56.812431 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:56.812747 12165 external_mini_cluster.cc:1428] Setting key b9df25924836a6b9f7686e96f28d0ac6
I20260811 15:02:56.816519 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff: Bootstrap starting.
I20260811 15:02:56.819574 17637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:56.820622 17637 log.cc:824] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:56.823022 17637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff: No bootstrap required, opened a new log
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:02:56.827993 17637 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } }
I20260811 15:02:56.828330 17637 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:56.828392 17637 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf187f6a88244502aa592433c496f8ff, State: Initialized, Role: FOLLOWER
I20260811 15:02:56.828917 17637 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } }
I20260811 15:02:56.829116 17637 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:56.829185 17637 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:56.829332 17637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:56.829591 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:56.814330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60243 (local address 127.11.225.126:39409)
0811 15:02:56.814762 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:56.814781 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:56.814824 (+ 43us) server_negotiation.cc:407] Connection header received
0811 15:02:56.815704 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:56.815729 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:56.816196 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:56.816588 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:56.817431 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:56.818990 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:56.819993 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:56.820720 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:56.820885 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:56.823688 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:56.823695 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:56.823712 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:56.823743 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:56.826042 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:56.826602 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:56.826608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:56.826615 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:56.826756 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:56.827181 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:56.827185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:56.827187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:56.827711 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:56.827943 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:56.828256 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 15:02:56.828501 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":115,"threads_started":1}
I20260811 15:02:56.830440 17637 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } }
I20260811 15:02:56.830816 17637 leader_election.cc:302] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf187f6a88244502aa592433c496f8ff; no voters:
I20260811 15:02:56.831203 17637 leader_election.cc:288] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:56.831336 17649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:56.831574 17649 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [term 1 LEADER]: Becoming Leader. State: Replica: bf187f6a88244502aa592433c496f8ff, State: Running, Role: LEADER
I20260811 15:02:56.831940 17649 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } }
I20260811 15:02:56.832695 17637 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:56.833277 17649 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf187f6a88244502aa592433c496f8ff. Latest consensus state: current_term: 1 leader_uuid: "bf187f6a88244502aa592433c496f8ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } } }
I20260811 15:02:56.833415 17649 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:56.833425 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:56.833752 17652 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf187f6a88244502aa592433c496f8ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf187f6a88244502aa592433c496f8ff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 39409 } } }
I20260811 15:02:56.833850 17652 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:56.834019 17654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:56.837482 17654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:56.843924 17654 catalog_manager.cc:1347] Generated new cluster ID: 5782668ed9e7432592a80623cf514657
I20260811 15:02:56.844002 17654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:56.846848 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:56.835889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50401 (local address 127.11.225.126:39409)
0811 15:02:56.835996 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:56.836000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:56.837190 (+ 1190us) server_negotiation.cc:407] Connection header received
0811 15:02:56.837357 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:56.837377 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:56.837430 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:56.837530 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:56.838626 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:56.839371 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:56.840628 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:56.840986 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:56.841097 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:56.843030 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:56.843035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:56.843038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:02:56.843064 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:56.844857 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:56.845440 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:56.845444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:56.845445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:56.845538 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:02:56.845904 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:02:56.845908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:02:56.845909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:02:56.846097 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:56.846273 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:56.846579 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 15:02:56.846674 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:02:56.853632 17654 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:56.854873 17654 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:56.870388 17654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf187f6a88244502aa592433c496f8ff: Generated new TSK 0
I20260811 15:02:56.871325 17654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:56.875310 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17514
W20260811 15:02:56.895015 17492 connection.cc:535] client connection to 127.11.225.126:39409 recv error: Network error: failed to read from TLS socket (remote: 127.11.225.126:39409): Connection reset by peer (error 104)
2026-08-11T15:02:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1709 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17691](info): set up 2 sockets
Aug 11 15:02:56 dist-test-slave-8hhm krb5kdc[17691](info): commencing operation
krb5kdc: starting...
W20260811 15:02:58.189906 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:58 dist-test-slave-8hhm krb5kdc[17691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:02:58.320494 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41751
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:35661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:41751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:02:58.434875 17710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:02:58.435209 17710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:02:58.435278 17710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:02:58.439280 17710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:02:58.439370 17710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:02:58.439407 17710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:02:58.439464 17710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:02:58.439502 17710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:02:58.444816 17710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:35661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:41751
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:41751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:02:58.445982 17710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:02:58.447006 17710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:02:58.456043 17723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:02:58.455998 17720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:58.456171 17710 server_base.cc:1034] running on GCE node
W20260811 15:02:58.455998 17725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:02:58.456992 17710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:02:58.458236 17710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:02:58.459426 17710 hybrid_clock.cc:648] HybridClock initialized: now 1786460578459395 us; error 44 us; skew 500 ppm
Aug 11 15:02:58 dist-test-slave-8hhm krb5kdc[17691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:02:58.462335 17710 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:02:58.463213 17710 webserver.cc:460] Webserver started at http://127.11.225.126:34941/ using document root <none> and password file <none>
I20260811 15:02:58.463725 17710 fs_manager.cc:359] Metadata directory not provided
I20260811 15:02:58.463781 17710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:02:58.463944 17710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:02:58.466024 17710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "5f17cb62e7f34c809a535f84f121ec11"
format_stamp: "Formatted at 2026-08-11 15:02:58 on dist-test-slave-8hhm"
server_key: "d403a019bc95e99ce1380c6bdfb63178"
server_key_iv: "be74cb58abb94479119670f426f7cf01"
server_key_version: "encryptionkey@0"
I20260811 15:02:58.466552 17710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "5f17cb62e7f34c809a535f84f121ec11"
format_stamp: "Formatted at 2026-08-11 15:02:58 on dist-test-slave-8hhm"
server_key: "d403a019bc95e99ce1380c6bdfb63178"
server_key_iv: "be74cb58abb94479119670f426f7cf01"
server_key_version: "encryptionkey@0"
I20260811 15:02:58.470271 17710 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:02:58.472653 17736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:02:58.473932 17710 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:02:58.474099 17710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "5f17cb62e7f34c809a535f84f121ec11"
format_stamp: "Formatted at 2026-08-11 15:02:58 on dist-test-slave-8hhm"
server_key: "d403a019bc95e99ce1380c6bdfb63178"
server_key_iv: "be74cb58abb94479119670f426f7cf01"
server_key_version: "encryptionkey@0"
I20260811 15:02:58.474190 17710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:02:58.489773 17710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:02:58.492697 17710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:02:58.492910 17710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:02:58.500624 17710 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:41751
I20260811 15:02:58.500653 17833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:41751 every 8 connection(s)
I20260811 15:02:58.501685 17710 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:02:58.504446 17834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:02:58.507710 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17710
I20260811 15:02:58.507892 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:02:58.508237 12165 external_mini_cluster.cc:1428] Setting key fe298a3396bfc3b6cb122641f59c1b52
I20260811 15:02:58.510778 17834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: Bootstrap starting.
I20260811 15:02:58.513176 17834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: Neither blocks nor log segments found. Creating new log.
I20260811 15:02:58.514007 17834 log.cc:824] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: Log is configured to *not* fsync() on all Append() calls
I20260811 15:02:58.516059 17834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: No bootstrap required, opened a new log
I20260811 15:02:58.517845 17844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:58.509850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41267 (local address 127.11.225.126:41751)
0811 15:02:58.510382 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:58.510418 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:58.510457 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:02:58.511185 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:58.511204 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:58.511558 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:58.511913 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:58.512371 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:58.513464 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:58.514446 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:58.514925 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:58.515112 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:58.516035 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:58.516040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:58.516053 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:58.516517 (+ 464us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:58.516570 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:58.516593 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:58.516731 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:58.516882 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 15:02:58.517044 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":208,"threads_started":1}
I20260811 15:02:58.520139 17834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } }
I20260811 15:02:58.520401 17834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:02:58.520490 17834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f17cb62e7f34c809a535f84f121ec11, State: Initialized, Role: FOLLOWER
I20260811 15:02:58.520749 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:02:58.521010 17834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } }
I20260811 15:02:58.521178 17834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:02:58.521292 17834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:02:58.521404 17834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:02:58.522574 17834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } }
I20260811 15:02:58.523033 17834 leader_election.cc:302] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f17cb62e7f34c809a535f84f121ec11; no voters:
I20260811 15:02:58.523389 17834 leader_election.cc:288] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:02:58.523494 17853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:02:58.523686 17853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [term 1 LEADER]: Becoming Leader. State: Replica: 5f17cb62e7f34c809a535f84f121ec11, State: Running, Role: LEADER
I20260811 15:02:58.523994 17853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } }
I20260811 15:02:58.524736 17834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:02:58.525243 17853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f17cb62e7f34c809a535f84f121ec11. Latest consensus state: current_term: 1 leader_uuid: "5f17cb62e7f34c809a535f84f121ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } } }
I20260811 15:02:58.525373 17853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:58.526283 17855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f17cb62e7f34c809a535f84f121ec11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f17cb62e7f34c809a535f84f121ec11" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 41751 } } }
I20260811 15:02:58.526384 17855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11 [sys.catalog]: This master's current role is: LEADER
I20260811 15:02:58.528059 17844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:02:58.523313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41941 (local address 127.11.225.126:41751)
0811 15:02:58.523461 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:02:58.523467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:02:58.523488 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:02:58.523524 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:02:58.523526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:02:58.523560 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:02:58.523645 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:02:58.523936 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:58.524621 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:58.525779 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:02:58.526137 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:02:58.526250 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:02:58.527361 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:02:58.527367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:02:58.527372 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:02:58.527391 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:02:58.527421 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:02:58.527435 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:02:58.527543 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:02:58.527855 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 15:02:58.527894 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 15:02:58.530583 17881 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:02:58.530687 17881 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:02:58.530793 17859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:02:58.531579 17859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:02:58.537128 17859 catalog_manager.cc:1347] Generated new cluster ID: b568565c21184436bcfa80b312da79c4
I20260811 15:02:58.537200 17859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:02:58.544155 17859 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:02:58.545083 17859 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:02:58.549919 17859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f17cb62e7f34c809a535f84f121ec11: Generated new TSK 0
I20260811 15:02:58.550621 17859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:02:58.558279 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17710
W20260811 15:02:58.577411 17685 connection.cc:535] client connection to 127.11.225.126:41751 recv error: Network error: failed to read from TLS socket (remote: 127.11.225.126:41751): Connection reset by peer (error 104)
2026-08-11T15:02:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1682 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:02:58 dist-test-slave-8hhm krb5kdc[17890](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:02:58 dist-test-slave-8hhm krb5kdc[17890](info): set up 2 sockets
Aug 11 15:02:58 dist-test-slave-8hhm krb5kdc[17890](info): commencing operation
krb5kdc: starting...
W20260811 15:02:59.873324 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:02:59 dist-test-slave-8hhm krb5kdc[17890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:02:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:02:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:00.008664 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45693
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:41275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:45693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:00.124106 17925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:00.124361 17925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:00.124401 17925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:00.128319 17925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:00.128378 17925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:00.128397 17925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:00.128414 17925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:00.128430 17925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:00.133877 17925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:41275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:45693
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:45693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:00.134917 17925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:00.135892 17925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:00.144578 17934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:00.144619 17935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:00.144619 17938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:00.144784 17925 server_base.cc:1034] running on GCE node
I20260811 15:03:00.145524 17925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:00.146633 17925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:00.147854 17925 hybrid_clock.cc:648] HybridClock initialized: now 1786460580147829 us; error 48 us; skew 500 ppm
Aug 11 15:03:00 dist-test-slave-8hhm krb5kdc[17890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460580, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:00.155395 17925 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:00.156500 17925 webserver.cc:460] Webserver started at http://127.11.225.126:42557/ using document root <none> and password file <none>
I20260811 15:03:00.157146 17925 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:00.157275 17925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:00.157543 17925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:00.159745 17925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "d50a2c796dd34ba19bbc1c38670cd3bf"
format_stamp: "Formatted at 2026-08-11 15:03:00 on dist-test-slave-8hhm"
server_key: "1aa3d91ef7f2d4790f2af01bec6f75d0"
server_key_iv: "0e53e197e685b5a30ace00e87acb7383"
server_key_version: "encryptionkey@0"
I20260811 15:03:00.160356 17925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "d50a2c796dd34ba19bbc1c38670cd3bf"
format_stamp: "Formatted at 2026-08-11 15:03:00 on dist-test-slave-8hhm"
server_key: "1aa3d91ef7f2d4790f2af01bec6f75d0"
server_key_iv: "0e53e197e685b5a30ace00e87acb7383"
server_key_version: "encryptionkey@0"
I20260811 15:03:00.164386 17925 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:03:00.167006 17950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:00.168325 17925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:00.168476 17925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "d50a2c796dd34ba19bbc1c38670cd3bf"
format_stamp: "Formatted at 2026-08-11 15:03:00 on dist-test-slave-8hhm"
server_key: "1aa3d91ef7f2d4790f2af01bec6f75d0"
server_key_iv: "0e53e197e685b5a30ace00e87acb7383"
server_key_version: "encryptionkey@0"
I20260811 15:03:00.168592 17925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:00.173524 17925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:00.176791 17925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:00.177031 17925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:00.184711 17925 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:45693
I20260811 15:03:00.184738 18051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:45693 every 8 connection(s)
I20260811 15:03:00.185781 17925 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:00.186146 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 17925
I20260811 15:03:00.186298 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:00.186583 12165 external_mini_cluster.cc:1428] Setting key 3089f334ddd8fe532500da31c6455ffa
I20260811 15:03:00.189097 18053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:00.192118 18059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:00.188112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38411 (local address 127.11.225.126:45693)
0811 15:03:00.188592 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:00.188607 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:00.188644 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:03:00.189430 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:00.189450 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:00.189745 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:00.190107 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:00.190920 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:00.190925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:00.190937 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:00.190947 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:00.191000 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:00.191025 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:00.191186 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:00.191256 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 15:03:00.191411 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":152,"threads_started":1}
I20260811 15:03:00.195175 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:00.195755 18053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf: Bootstrap starting.
I20260811 15:03:00.198434 18053 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:00.199111 18059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:00.197309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39647 (local address 127.11.225.126:45693)
0811 15:03:00.197439 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:00.197444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:00.197705 (+ 261us) server_negotiation.cc:407] Connection header received
0811 15:03:00.197831 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:00.197833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:00.197866 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:00.197930 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:00.198688 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:00.198691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:00.198693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:00.198703 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:00.198729 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:00.198739 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:00.198807 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:00.198923 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 15:03:00.198956 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:03:00.199430 18053 log.cc:824] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:00.201498 18053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf: No bootstrap required, opened a new log
I20260811 15:03:00.205018 18053 raft_consensus.cc:348] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } }
I20260811 15:03:00.205305 18053 raft_consensus.cc:374] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:00.205392 18053 raft_consensus.cc:729] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d50a2c796dd34ba19bbc1c38670cd3bf, State: Initialized, Role: FOLLOWER
I20260811 15:03:00.205832 18053 consensus_queue.cc:260] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } }
I20260811 15:03:00.205998 18053 raft_consensus.cc:388] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:00.206087 18053 raft_consensus.cc:482] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:00.206192 18053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:00.207145 18053 raft_consensus.cc:504] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } }
I20260811 15:03:00.207507 18053 leader_election.cc:302] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d50a2c796dd34ba19bbc1c38670cd3bf; no voters:
I20260811 15:03:00.207858 18053 leader_election.cc:288] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:00.207935 18072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:00.208213 18072 raft_consensus.cc:686] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [term 1 LEADER]: Becoming Leader. State: Replica: d50a2c796dd34ba19bbc1c38670cd3bf, State: Running, Role: LEADER
I20260811 15:03:00.208624 18072 consensus_queue.cc:237] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } }
I20260811 15:03:00.209313 18053 sys_catalog.cc:564] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:00.210601 18076 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d50a2c796dd34ba19bbc1c38670cd3bf. Latest consensus state: current_term: 1 leader_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } } }
I20260811 15:03:00.210608 18075 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50a2c796dd34ba19bbc1c38670cd3bf" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 45693 } } }
I20260811 15:03:00.210760 18076 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:00.210762 18075 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:00.211140 18090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:00.215349 18090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:00.221163 18090 catalog_manager.cc:1347] Generated new cluster ID: e7b75aca888d4cc09d8b8bb06a992ddf
I20260811 15:03:00.221310 18090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:00.228744 18090 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:00.229068 18090 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:00.234560 18090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d50a2c796dd34ba19bbc1c38670cd3bf: Generated new TSK 0
I20260811 15:03:00.235355 18090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:00.243916 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 17925
2026-08-11T15:03:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1685 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:00 dist-test-slave-8hhm krb5kdc[18112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:00 dist-test-slave-8hhm krb5kdc[18112](info): set up 2 sockets
Aug 11 15:03:00 dist-test-slave-8hhm krb5kdc[18112](info): commencing operation
krb5kdc: starting...
W20260811 15:03:01.570302 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:03:01 dist-test-slave-8hhm krb5kdc[18112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:01.706987 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43587
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:43587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:01.826354 18137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:01.826699 18137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:01.826779 18137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:01.830915 18137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:01.831082 18137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:01.831138 18137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:01.831175 18137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:01.831212 18137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:01.836912 18137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:43587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:43587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:01.838178 18137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:01.839318 18137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:01.848227 18148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:01.848284 18150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:01.848232 18152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:01.848423 18137 server_base.cc:1034] running on GCE node
I20260811 15:03:01.849146 18137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:01.850337 18137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:01.851547 18137 hybrid_clock.cc:648] HybridClock initialized: now 1786460581851527 us; error 25 us; skew 500 ppm
Aug 11 15:03:01 dist-test-slave-8hhm krb5kdc[18112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:01.854517 18137 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:01.855423 18137 webserver.cc:460] Webserver started at http://127.11.225.126:35709/ using document root <none> and password file <none>
I20260811 15:03:01.856002 18137 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:01.856101 18137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:01.856340 18137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:01.858630 18137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "2608ce1404de45c494c84726090c5cff"
format_stamp: "Formatted at 2026-08-11 15:03:01 on dist-test-slave-8hhm"
server_key: "ce0902ae3027a5860b21101ca80f1f78"
server_key_iv: "836ea7db33d95ecd3382da7db9211089"
server_key_version: "encryptionkey@0"
I20260811 15:03:01.859222 18137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "2608ce1404de45c494c84726090c5cff"
format_stamp: "Formatted at 2026-08-11 15:03:01 on dist-test-slave-8hhm"
server_key: "ce0902ae3027a5860b21101ca80f1f78"
server_key_iv: "836ea7db33d95ecd3382da7db9211089"
server_key_version: "encryptionkey@0"
I20260811 15:03:01.863261 18137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:01.865850 18163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:01.867267 18137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:01.867436 18137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "2608ce1404de45c494c84726090c5cff"
format_stamp: "Formatted at 2026-08-11 15:03:01 on dist-test-slave-8hhm"
server_key: "ce0902ae3027a5860b21101ca80f1f78"
server_key_iv: "836ea7db33d95ecd3382da7db9211089"
server_key_version: "encryptionkey@0"
I20260811 15:03:01.867575 18137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:01.886700 18137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:01.889954 18137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:01.890225 18137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:01.898167 18137 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:43587
I20260811 15:03:01.898187 18254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:43587 every 8 connection(s)
I20260811 15:03:01.899184 18137 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:01.902211 18257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:01.905014 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18137
I20260811 15:03:01.905254 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:01.905573 12165 external_mini_cluster.cc:1428] Setting key e42328841a0d8fac210b3a3682253552
I20260811 15:03:01.908703 18257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: Bootstrap starting.
I20260811 15:03:01.911504 18257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:01.912324 18257 log.cc:824] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:01.914455 18257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: No bootstrap required, opened a new log
Aug 11 15:03:01 dist-test-slave-8hhm krb5kdc[18112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:03:01.918044 18257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } }
I20260811 15:03:01.918267 18257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:01.918326 18257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2608ce1404de45c494c84726090c5cff, State: Initialized, Role: FOLLOWER
I20260811 15:03:01.918772 18257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } }
I20260811 15:03:01.918926 18257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:01.918998 18257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:01.919116 18257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:01.920185 18257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } }
I20260811 15:03:01.920571 18257 leader_election.cc:302] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2608ce1404de45c494c84726090c5cff; no voters:
I20260811 15:03:01.920962 18257 leader_election.cc:288] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:01.921058 18272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:01.921307 18272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [term 1 LEADER]: Becoming Leader. State: Replica: 2608ce1404de45c494c84726090c5cff, State: Running, Role: LEADER
I20260811 15:03:01.921682 18272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } }
I20260811 15:03:01.922063 18266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:01.907089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48827 (local address 127.11.225.126:43587)
0811 15:03:01.907535 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:01.907556 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:01.907615 (+ 59us) server_negotiation.cc:407] Connection header received
0811 15:03:01.908441 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:01.908464 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:01.908904 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:01.909299 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:01.910028 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:01.911519 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:01.912446 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:01.913048 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:01.913223 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:01.916153 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:01.916159 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:01.916173 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:01.916200 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:01.918823 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:01.919357 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:01.919361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:01.919366 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:01.919482 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:01.919782 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:01.919784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:01.919785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:01.920222 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:01.920452 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:01.920722 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 15:03:01.921079 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":123,"threads_started":1}
I20260811 15:03:01.922381 18257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:01.922953 18272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2608ce1404de45c494c84726090c5cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } } }
I20260811 15:03:01.923822 18272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:01.923707 18274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2608ce1404de45c494c84726090c5cff. Latest consensus state: current_term: 1 leader_uuid: "2608ce1404de45c494c84726090c5cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2608ce1404de45c494c84726090c5cff" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 43587 } } }
I20260811 15:03:01.924940 18274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:01.925554 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 15:03:01.928215 18296 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:01.928298 18296 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:01.928398 18284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:01.929072 18284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:01.938560 18284 catalog_manager.cc:1347] Generated new cluster ID: f6cc3a349ac14fa2aa6cc07bb4d07119
I20260811 15:03:01.938628 18284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:01.939244 18266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:01.927804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60997 (local address 127.11.225.126:43587)
0811 15:03:01.927917 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:01.927922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:01.928166 (+ 244us) server_negotiation.cc:407] Connection header received
0811 15:03:01.928287 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:01.928290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:01.928337 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:01.928415 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:01.929349 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:01.930104 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:01.931308 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:01.931646 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:01.931776 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:01.933564 (+ 1788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:01.933570 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:01.933574 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:01.933602 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:01.937080 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:01.937569 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:01.937573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:01.937575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:01.937673 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:01.937957 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:01.937960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:01.937962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:01.938148 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:01.938298 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:01.938977 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 15:03:01.939100 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:01.988672 18284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:01.989735 18284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:01.995956 18284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2608ce1404de45c494c84726090c5cff: Generated new TSK 0
I20260811 15:03:01.996814 18284 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:02.003186 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18137
2026-08-11T15:03:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1754 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:02 dist-test-slave-8hhm krb5kdc[18313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:02 dist-test-slave-8hhm krb5kdc[18313](info): set up 2 sockets
Aug 11 15:03:02 dist-test-slave-8hhm krb5kdc[18313](info): commencing operation
krb5kdc: starting...
W20260811 15:03:03.325426 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:03:03 dist-test-slave-8hhm krb5kdc[18313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:03.468317 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36887
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:40973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:36887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:03.584349 18335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:03.584607 18335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:03.584651 18335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:03.588641 18335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:03.588701 18335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:03.588719 18335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:03.588735 18335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:03.588804 18335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:03.594110 18335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:40973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:36887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:03.595230 18335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:03.596304 18335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:03.605100 18344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:03.605297 18335 server_base.cc:1034] running on GCE node
W20260811 15:03:03.605078 18351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:03.605166 18346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:03.606175 18335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:03.607266 18335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:03.608439 18335 hybrid_clock.cc:648] HybridClock initialized: now 1786460583608401 us; error 52 us; skew 500 ppm
Aug 11 15:03:03 dist-test-slave-8hhm krb5kdc[18313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460583, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:03.611266 18335 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:03.612232 18335 webserver.cc:460] Webserver started at http://127.11.225.126:33359/ using document root <none> and password file <none>
I20260811 15:03:03.612818 18335 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:03.612916 18335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:03.613165 18335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:03.615300 18335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "3d4e45b6ed714e8e915d4e218ff8517b"
format_stamp: "Formatted at 2026-08-11 15:03:03 on dist-test-slave-8hhm"
server_key: "3a21ee199b0bdfce169ff5e377fb5874"
server_key_iv: "6322ae6583f297fb56119f6125b5e40b"
server_key_version: "encryptionkey@0"
I20260811 15:03:03.615909 18335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "3d4e45b6ed714e8e915d4e218ff8517b"
format_stamp: "Formatted at 2026-08-11 15:03:03 on dist-test-slave-8hhm"
server_key: "3a21ee199b0bdfce169ff5e377fb5874"
server_key_iv: "6322ae6583f297fb56119f6125b5e40b"
server_key_version: "encryptionkey@0"
I20260811 15:03:03.619732 18335 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:03.622205 18361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:03.623437 18335 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:03.623597 18335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "3d4e45b6ed714e8e915d4e218ff8517b"
format_stamp: "Formatted at 2026-08-11 15:03:03 on dist-test-slave-8hhm"
server_key: "3a21ee199b0bdfce169ff5e377fb5874"
server_key_iv: "6322ae6583f297fb56119f6125b5e40b"
server_key_version: "encryptionkey@0"
I20260811 15:03:03.623715 18335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:03.648435 18335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:03.651675 18335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:03.651947 18335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:03.659914 18335 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:36887
I20260811 15:03:03.659955 18457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:36887 every 8 connection(s)
I20260811 15:03:03.660945 18335 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:03.664160 18463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:03.666159 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18335
I20260811 15:03:03.666339 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:03.666667 12165 external_mini_cluster.cc:1428] Setting key 100bc433b121f5e43cb5dfc95dd1725e
I20260811 15:03:03.671315 18463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: Bootstrap starting.
I20260811 15:03:03.673882 18463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:03.674700 18463 log.cc:824] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:03.676488 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:03.668296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56709 (local address 127.11.225.126:36887)
0811 15:03:03.668785 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:03.668802 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:03.668850 (+ 48us) server_negotiation.cc:407] Connection header received
0811 15:03:03.669629 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:03.669650 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:03.670013 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:03.670373 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:03.670814 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:03.671880 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:03.672845 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:03.673454 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:03.673642 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:03.674617 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:03.674624 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:03.674638 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:03.675124 (+ 486us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:03.675203 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:03.675241 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:03.675358 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:03.675553 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 15:03:03.675756 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":153,"threads_started":1}
I20260811 15:03:03.677095 18463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: No bootstrap required, opened a new log
I20260811 15:03:03.679836 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:03.682101 18463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } }
I20260811 15:03:03.682451 18463 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:03.682528 18463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d4e45b6ed714e8e915d4e218ff8517b, State: Initialized, Role: FOLLOWER
I20260811 15:03:03.683048 18463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } }
I20260811 15:03:03.683228 18463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:03.683296 18463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:03.683398 18463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:03.684515 18463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } }
I20260811 15:03:03.684919 18463 leader_election.cc:302] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d4e45b6ed714e8e915d4e218ff8517b; no voters:
I20260811 15:03:03.685350 18463 leader_election.cc:288] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:03.685482 18476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:03.685736 18476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [term 1 LEADER]: Becoming Leader. State: Replica: 3d4e45b6ed714e8e915d4e218ff8517b, State: Running, Role: LEADER
I20260811 15:03:03.686091 18476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } }
I20260811 15:03:03.686738 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:03.682144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40779 (local address 127.11.225.126:36887)
0811 15:03:03.682265 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:03.682269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:03.682397 (+ 128us) server_negotiation.cc:407] Connection header received
0811 15:03:03.682586 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:03.682590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:03.682644 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:03.682738 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:03.683034 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:03.683793 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:03.684705 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:03.685069 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:03.685178 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:03.686239 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:03.686242 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:03.686245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:03.686257 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:03.686286 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:03.686300 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:03.686365 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:03.686541 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 15:03:03.686609 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:03.686877 18463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:03.687443 18479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d4e45b6ed714e8e915d4e218ff8517b. Latest consensus state: current_term: 1 leader_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } } }
I20260811 15:03:03.687572 18479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:03.688282 18477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4e45b6ed714e8e915d4e218ff8517b" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36887 } } }
I20260811 15:03:03.688383 18477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:03.691886 18501 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:03.691952 18501 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:03.692039 18485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:03.692809 18485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:03.698918 18485 catalog_manager.cc:1347] Generated new cluster ID: 62f84f1d57434dd2a6151282d2000f7b
I20260811 15:03:03.699000 18485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:03.714974 18485 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:03.715951 18485 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:03.722831 18485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d4e45b6ed714e8e915d4e218ff8517b: Generated new TSK 0
I20260811 15:03:03.723580 18485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:03.729444 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18335
2026-08-11T15:03:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1728 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:03 dist-test-slave-8hhm krb5kdc[18509](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:03 dist-test-slave-8hhm krb5kdc[18509](info): set up 2 sockets
Aug 11 15:03:03 dist-test-slave-8hhm krb5kdc[18509](info): commencing operation
krb5kdc: starting...
W20260811 15:03:05.040056 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:03:05 dist-test-slave-8hhm krb5kdc[18509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:05.176960 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40805
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:40805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:05.298552 18542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:05.298895 18542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:05.298990 18542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:05.303117 18542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:05.303237 18542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:05.303275 18542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:05.303313 18542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:05.303349 18542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:05.308892 18542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:40805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:40805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:05.310111 18542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:05.311220 18542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:05.320406 18556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:05.320432 18552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:05.320462 18542 server_base.cc:1034] running on GCE node
W20260811 15:03:05.320405 18553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:05.321337 18542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:05.322501 18542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:05.323707 18542 hybrid_clock.cc:648] HybridClock initialized: now 1786460585323652 us; error 66 us; skew 500 ppm
Aug 11 15:03:05 dist-test-slave-8hhm krb5kdc[18509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:05.330753 18542 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:05.331830 18542 webserver.cc:460] Webserver started at http://127.11.225.126:33397/ using document root <none> and password file <none>
I20260811 15:03:05.332476 18542 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:05.332576 18542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:05.332831 18542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:05.335093 18542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "221f696776de4d48b6ff240682405a0d"
format_stamp: "Formatted at 2026-08-11 15:03:05 on dist-test-slave-8hhm"
server_key: "63286ff458575d0d26fd0a55d8677ea6"
server_key_iv: "5a44bbf391987fdc6b3d221cf578911e"
server_key_version: "encryptionkey@0"
I20260811 15:03:05.335698 18542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "221f696776de4d48b6ff240682405a0d"
format_stamp: "Formatted at 2026-08-11 15:03:05 on dist-test-slave-8hhm"
server_key: "63286ff458575d0d26fd0a55d8677ea6"
server_key_iv: "5a44bbf391987fdc6b3d221cf578911e"
server_key_version: "encryptionkey@0"
I20260811 15:03:05.339705 18542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 15:03:05.342389 18567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:05.343789 18542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:05.343940 18542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "221f696776de4d48b6ff240682405a0d"
format_stamp: "Formatted at 2026-08-11 15:03:05 on dist-test-slave-8hhm"
server_key: "63286ff458575d0d26fd0a55d8677ea6"
server_key_iv: "5a44bbf391987fdc6b3d221cf578911e"
server_key_version: "encryptionkey@0"
I20260811 15:03:05.344069 18542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:05.348999 18542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:05.352523 18542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:05.352748 18542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:05.360280 18542 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:40805
I20260811 15:03:05.360292 18658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:40805 every 8 connection(s)
I20260811 15:03:05.361411 18542 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:05.364238 18660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:05.364763 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18542
I20260811 15:03:05.364898 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:05.365258 12165 external_mini_cluster.cc:1428] Setting key 490245de727d77270cd7207ff24d548c
I20260811 15:03:05.370792 18663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:05.366838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46713 (local address 127.11.225.126:40805)
0811 15:03:05.367278 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:05.367293 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:05.367329 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:03:05.368067 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:05.368084 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:05.368370 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:05.368724 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:05.369600 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:05.369604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:05.369617 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:05.369627 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:05.369680 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:05.369699 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:05.369851 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:05.369922 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 15:03:05.370073 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":134,"threads_started":1}
I20260811 15:03:05.371775 18660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d: Bootstrap starting.
I20260811 15:03:05.373754 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:05.374490 18660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:05.375326 18660 log.cc:824] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:05.377667 18663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:05.375964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49319 (local address 127.11.225.126:40805)
0811 15:03:05.376095 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:05.376099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:05.376328 (+ 229us) server_negotiation.cc:407] Connection header received
0811 15:03:05.376418 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:05.376421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:05.376454 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:05.376528 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:05.377294 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:05.377297 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:05.377299 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:05.377312 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:05.377339 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:05.377352 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:05.377444 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:05.377517 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 15:03:05.377553 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:03:05.377735 18660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d: No bootstrap required, opened a new log
I20260811 15:03:05.381541 18660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } }
I20260811 15:03:05.381771 18660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:05.381846 18660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221f696776de4d48b6ff240682405a0d, State: Initialized, Role: FOLLOWER
I20260811 15:03:05.382364 18660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } }
I20260811 15:03:05.382546 18660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:05.382624 18660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:05.382728 18660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:05.383698 18660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } }
I20260811 15:03:05.384045 18660 leader_election.cc:302] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 221f696776de4d48b6ff240682405a0d; no voters:
I20260811 15:03:05.384405 18660 leader_election.cc:288] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:05.384486 18676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:05.384758 18676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [term 1 LEADER]: Becoming Leader. State: Replica: 221f696776de4d48b6ff240682405a0d, State: Running, Role: LEADER
I20260811 15:03:05.385109 18676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } }
I20260811 15:03:05.385792 18660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:05.387231 18678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "221f696776de4d48b6ff240682405a0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } } }
I20260811 15:03:05.387243 18679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 221f696776de4d48b6ff240682405a0d. Latest consensus state: current_term: 1 leader_uuid: "221f696776de4d48b6ff240682405a0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221f696776de4d48b6ff240682405a0d" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 40805 } } }
I20260811 15:03:05.387425 18678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:05.387446 18679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:05.388520 18688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:05.392019 18688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:05.398180 18688 catalog_manager.cc:1347] Generated new cluster ID: dcd59357f2704b5bb1af08d95b160f2a
I20260811 15:03:05.398263 18688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:05.406486 18688 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:05.406875 18688 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:05.412559 18688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 221f696776de4d48b6ff240682405a0d: Generated new TSK 0
I20260811 15:03:05.413436 18688 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:05.423429 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18542
2026-08-11T15:03:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1687 ms)
[----------] 18 tests from AuthTokenIssuingTest (30688 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:05 dist-test-slave-8hhm krb5kdc[18706](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:05 dist-test-slave-8hhm krb5kdc[18706](info): set up 2 sockets
Aug 11 15:03:05 dist-test-slave-8hhm krb5kdc[18706](info): commencing operation
krb5kdc: starting...
W20260811 15:03:06.719712 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:03:06 dist-test-slave-8hhm krb5kdc[18706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:06.860229 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36469
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:06.982951 18729 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:06.983337 18729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:06.983410 18729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:06.983485 18729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:06.987493 18729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:06.987598 18729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:06.987638 18729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:06.987671 18729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:06.987700 18729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:06.993052 18729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:36469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:06.994230 18729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:06.995306 18729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:07.004426 18739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.004446 18745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.004510 18738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:07.004642 18729 server_base.cc:1034] running on GCE node
I20260811 15:03:07.005378 18729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:07.006546 18729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:07.007725 18729 hybrid_clock.cc:648] HybridClock initialized: now 1786460587007709 us; error 31 us; skew 500 ppm
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:07.010727 18729 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:07.011710 18729 webserver.cc:460] Webserver started at http://127.11.225.126:39869/ using document root <none> and password file <none>
I20260811 15:03:07.012251 18729 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:07.012315 18729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:07.012490 18729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:07.014652 18729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "b551e0b1ab1146088fe1d2c291ae0623"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "4f9afe8d2a6112387d8c85f03422d5f4"
server_key_iv: "2149c55cc3cec26e6e0e982b27e2eb7f"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.015198 18729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "b551e0b1ab1146088fe1d2c291ae0623"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "4f9afe8d2a6112387d8c85f03422d5f4"
server_key_iv: "2149c55cc3cec26e6e0e982b27e2eb7f"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.019157 18729 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:07.021690 18752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:07.022992 18729 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:07.023138 18729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "b551e0b1ab1146088fe1d2c291ae0623"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "4f9afe8d2a6112387d8c85f03422d5f4"
server_key_iv: "2149c55cc3cec26e6e0e982b27e2eb7f"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.023247 18729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:07.042244 18729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:07.045974 18729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:07.046218 18729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:07.054136 18729 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:36469
I20260811 15:03:07.054446 18832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:36469 every 8 connection(s)
I20260811 15:03:07.055307 18729 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:07.058346 18833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:07.058624 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18729
I20260811 15:03:07.058772 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:07.059113 12165 external_mini_cluster.cc:1428] Setting key 65b0d4a7004b381257a6afda1e08ffde
I20260811 15:03:07.063333 18833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.225.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.125@KRBTEST.COM" created.
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:03:07.080662 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.065958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36469 (local address 127.0.0.1:45336)
0811 15:03:07.066613 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.066676 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.067941 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.068884 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.068892 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.069349 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.069679 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.069696 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.070868 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.070871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.071769 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.071779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.072466 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.072470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.072564 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.073255 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.073284 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.075029 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.077528 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.077537 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.077546 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.077786 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.078206 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.078209 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.078210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.078325 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.079176 (+ 851us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.079182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.079312 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.079450 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.079722 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"spinlock_wait_cycles":896,"thread_start_us":158,"threads_started":1}
I20260811 15:03:07.080664 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.065958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45336 (local address 127.11.225.126:36469)
0811 15:03:07.066567 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.066585 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.066814 (+ 229us) server_negotiation.cc:407] Connection header received
0811 15:03:07.068379 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.068384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.068635 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.068823 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.069831 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.070746 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.071906 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.072298 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.072485 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.075189 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.075200 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.075218 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.075252 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.077416 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.077920 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.077930 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.077935 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.078099 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.078434 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.078439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.078441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.079056 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.079221 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.079610 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.079790 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"spinlock_wait_cycles":29056,"thread_start_us":158,"threads_started":1}
I20260811 15:03:07.083247 18833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.084008 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.083745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48476)
0811 15:03:07.083875 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.083947 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 15:03:07.084345 18758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
I20260811 15:03:07.085331 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.085052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48492)
0811 15:03:07.085172 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.085261 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 15:03:07.085482 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:45469: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
I20260811 15:03:07.090466 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:45469
--webserver_interface=127.11.225.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:07.134735 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } attempt: 1
I20260811 15:03:07.135758 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.135430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48500)
0811 15:03:07.135602 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.135674 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 15:03:07.136575 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.136374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48514)
0811 15:03:07.136473 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.136521 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:03:07.136746 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:45469: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
I20260811 15:03:07.204957 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } attempt: 2
I20260811 15:03:07.205940 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.205614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48528)
0811 15:03:07.205773 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.205860 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 15:03:07.206858 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.206606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48544)
0811 15:03:07.206729 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.206783 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 15:03:07.207060 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:45469: Network error: Client connection negotiation failed: client connection to 127.11.225.125:45469: connect: Connection refused (error 111)
W20260811 15:03:07.209602 18847 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:07.209896 18847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:07.209920 18847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:07.209966 18847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:07.214152 18847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:07.214212 18847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:07.214232 18847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:07.214248 18847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:07.214263 18847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:07.220024 18847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:45469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.225.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:07.221159 18847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:07.222301 18847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:07.231096 18862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.231140 18858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.231187 18857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:07.231467 18847 server_base.cc:1034] running on GCE node
I20260811 15:03:07.232075 18847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:07.233294 18847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:07.234513 18847 hybrid_clock.cc:648] HybridClock initialized: now 1786460587234485 us; error 39 us; skew 500 ppm
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:07.237555 18847 init.cc:377] Logged in from keytab as kudu/127.11.225.125@KRBTEST.COM (short username kudu)
I20260811 15:03:07.238535 18847 webserver.cc:460] Webserver started at http://127.11.225.125:34333/ using document root <none> and password file <none>
I20260811 15:03:07.239111 18847 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:07.239200 18847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:07.239439 18847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:07.241598 18847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data/instance:
uuid: "7acd5927f19649449e92eaeb4d7ef4e2"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "9abede55047736f73baae7e3c0d6b923"
server_key_iv: "012f2f291546af37136d592d6ca6b20a"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.242194 18847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal/instance:
uuid: "7acd5927f19649449e92eaeb4d7ef4e2"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "9abede55047736f73baae7e3c0d6b923"
server_key_iv: "012f2f291546af37136d592d6ca6b20a"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.246207 18847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:03:07.250216 18872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:07.252121 18847 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:07.252255 18847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "7acd5927f19649449e92eaeb4d7ef4e2"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "9abede55047736f73baae7e3c0d6b923"
server_key_iv: "012f2f291546af37136d592d6ca6b20a"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.252377 18847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:07.278551 18847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:07.281697 18847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:07.281913 18847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:07.289160 18847 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.125:45469
I20260811 15:03:07.289495 18962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.125:45469 every 8 connection(s)
I20260811 15:03:07.290292 18847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
I20260811 15:03:07.293331 18964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:07.297353 18964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.298249 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } attempt: 3
I20260811 15:03:07.298808 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18847
I20260811 15:03:07.298956 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-1/wal/instance
I20260811 15:03:07.299274 12165 external_mini_cluster.cc:1428] Setting key b094f47f2e5d1cdd1180cdc9eafc9309
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.124@KRBTEST.COM; defaulting to no policy
I20260811 15:03:07.312500 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.299416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45346 (local address 127.11.225.126:36469)
0811 15:03:07.299519 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.299524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.300482 (+ 958us) server_negotiation.cc:407] Connection header received
0811 15:03:07.301363 (+ 881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.301366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.301414 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.301469 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.302667 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.303315 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.304319 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.305273 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.305363 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.308574 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.308579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.308583 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.308614 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.310155 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.310799 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.310802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.310803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.310883 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.311268 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.311271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.311272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.311545 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.311650 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.312177 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.312324 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":42}
I20260811 15:03:07.312875 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.298797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48548)
0811 15:03:07.299022 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.299041 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.299150 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.301628 (+ 2478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.301635 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.301879 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.302036 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.302046 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.303486 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.303492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.304406 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.304422 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.305336 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.305342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.305493 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.306064 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.306079 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.307659 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.310609 (+ 2950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.310613 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.310615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.310864 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.311228 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.311234 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.311240 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.311333 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.312065 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.312069 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.312180 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.312283 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.312418 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.124@KRBTEST.COM" created.
I20260811 15:03:07.313551 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.299691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48548 (local address 127.11.225.125:45469)
0811 15:03:07.300150 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.300171 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.300213 (+ 42us) server_negotiation.cc:407] Connection header received
0811 15:03:07.301088 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.301113 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.301395 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.301671 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.302194 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.303336 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.304545 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.305191 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.305388 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.307829 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.307840 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.307858 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.307888 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.310475 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.310984 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.310990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.310992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.311118 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.311437 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.311440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.311442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.311933 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.312038 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.312395 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.312636 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":312,"spinlock_wait_cycles":17280,"thread_start_us":161,"threads_started":1}
I20260811 15:03:07.313555 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.299692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36469 (local address 127.0.0.1:45346)
0811 15:03:07.300332 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.300386 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.301088 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.301691 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.301696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.302204 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.302506 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.302519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.303445 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.303448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.304187 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.304196 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.305557 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.305560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.305639 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.306245 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.306261 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.308372 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.310289 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.310299 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.310311 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.310689 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.311023 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.311025 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.311027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.311148 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.311670 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.311676 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.311915 (+ 239us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.312102 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.312445 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":10,"spinlock_wait_cycles":14592,"thread_start_us":207,"threads_started":1}
I20260811 15:03:07.315264 18964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.318136 18833 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.318988 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.318688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59306)
0811 15:03:07.318875 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.318923 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 15:03:07.319799 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.319455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59308)
0811 15:03:07.319644 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.319716 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260811 15:03:07.319954 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:07.325763 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.316081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48562)
0811 15:03:07.316204 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.316216 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.316285 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.316696 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.316699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.316881 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.316964 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.316969 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.317787 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.317793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.318645 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.318658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.319568 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.319571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.319659 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.320176 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.320188 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.321476 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.324194 (+ 2718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.324196 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.324198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.324393 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.324698 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.324699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.324701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.324774 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.325320 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.325323 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.325418 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.325504 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.325627 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 15:03:07.325886 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.316250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.11.225.125:45469)
0811 15:03:07.316513 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.316518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.316528 (+ 10us) server_negotiation.cc:407] Connection header received
0811 15:03:07.316550 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.316552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.316582 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.316683 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.317075 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.317685 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.318775 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.319232 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.319357 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.321648 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.321656 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.321661 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.321692 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.324083 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.324496 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.324502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.324504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.324603 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.324875 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.324880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.324885 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.325162 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.325337 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.325572 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.325698 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":118,"threads_started":1}
I20260811 15:03:07.326661 18964 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.327400 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.327131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59316)
0811 15:03:07.327252 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.327346 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:03:07.327844 18879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
I20260811 15:03:07.328842 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.328649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59332)
0811 15:03:07.328749 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.328793 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:03:07.329074 18964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
I20260811 15:03:07.334102 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:42293
--webserver_interface=127.11.225.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:42323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:07.351148 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 1
I20260811 15:03:07.352128 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.351759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59346)
0811 15:03:07.351935 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.352012 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 15:03:07.352905 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.352658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59348)
0811 15:03:07.352781 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.352835 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 15:03:07.353041 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
I20260811 15:03:07.378389 18964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 1
I20260811 15:03:07.379482 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.379098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59352)
0811 15:03:07.379275 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.379367 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 15:03:07.380304 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.380104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59360)
0811 15:03:07.380208 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.380254 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:03:07.380472 18964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
I20260811 15:03:07.428220 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 2
I20260811 15:03:07.429127 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.428756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59368)
0811 15:03:07.428940 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.429015 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 15:03:07.429955 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.429708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59382)
0811 15:03:07.429826 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.429886 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 15:03:07.430136 18833 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
I20260811 15:03:07.448658 18964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 2
I20260811 15:03:07.449618 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.449300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59384)
0811 15:03:07.449456 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.449523 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 15:03:07.450399 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.450178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59390)
0811 15:03:07.450288 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.450340 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 15:03:07.450567 18964 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:42293: Network error: Client connection negotiation failed: client connection to 127.11.225.124:42293: connect: Connection refused (error 111)
W20260811 15:03:07.457180 18974 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:07.457597 18974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:07.457648 18974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:07.457732 18974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:07.461859 18974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:07.461916 18974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:07.461936 18974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:07.461953 18974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:07.462004 18974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:07.467542 18974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:42323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:36469,127.11.225.125:45469,127.11.225.124:42293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:42293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.225.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:07.468734 18974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:07.469905 18974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:07.478698 18986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.478708 18982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:07.478686 18988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:07.478988 18974 server_base.cc:1034] running on GCE node
I20260811 15:03:07.479826 18974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:07.480988 18974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:07.482196 18974 hybrid_clock.cc:648] HybridClock initialized: now 1786460587482154 us; error 62 us; skew 500 ppm
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:07.485106 18974 init.cc:377] Logged in from keytab as kudu/127.11.225.124@KRBTEST.COM (short username kudu)
I20260811 15:03:07.486040 18974 webserver.cc:460] Webserver started at http://127.11.225.124:41289/ using document root <none> and password file <none>
I20260811 15:03:07.486555 18974 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:07.486616 18974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:07.486785 18974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:07.488785 18974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data/instance:
uuid: "ae509942e31a4813bc0c742b44407bb5"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "71a3c8afb8f8893e0f6a2cbd773f59cd"
server_key_iv: "79feced2f6db7cb80d0879a0065a02a3"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.489401 18974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal/instance:
uuid: "ae509942e31a4813bc0c742b44407bb5"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "71a3c8afb8f8893e0f6a2cbd773f59cd"
server_key_iv: "79feced2f6db7cb80d0879a0065a02a3"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.493793 18974 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:03:07.496238 19003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:07.497574 18974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:07.497707 18974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "ae509942e31a4813bc0c742b44407bb5"
format_stamp: "Formatted at 2026-08-11 15:03:07 on dist-test-slave-8hhm"
server_key: "71a3c8afb8f8893e0f6a2cbd773f59cd"
server_key_iv: "79feced2f6db7cb80d0879a0065a02a3"
server_key_version: "encryptionkey@0"
I20260811 15:03:07.497835 18974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:07.516098 18974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:07.519660 18974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:07.519886 18974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:07.527199 18974 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.124:42293
I20260811 15:03:07.527521 19092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.124:42293 every 8 connection(s)
I20260811 15:03:07.528347 18974 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
I20260811 15:03:07.529270 18833 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 3
I20260811 15:03:07.532171 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 18974
I20260811 15:03:07.532317 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460289406450-12165-0/minicluster-data/master-2/wal/instance
I20260811 15:03:07.532363 19095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:07.532639 12165 external_mini_cluster.cc:1428] Setting key 5b89e28592d2a314254006975d1573e7
I20260811 15:03:07.537508 19095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:03:07.541749 18964 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } attempt: 3
I20260811 15:03:07.544482 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.529772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59402)
0811 15:03:07.529910 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.529929 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.530023 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.532497 (+ 2474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.532501 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.532709 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.532838 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.532846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.534491 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.534497 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.535041 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.535050 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.536012 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.536016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.536129 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.536719 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.536734 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.538348 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.542330 (+ 3982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.542334 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.542336 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.542616 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.543026 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.543029 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.543031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.543124 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.543918 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.543920 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.544044 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.544133 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.544265 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":4}
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:03:07.546311 19099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.533269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59412 (local address 127.11.225.124:42293)
0811 15:03:07.533717 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.533725 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.534020 (+ 295us) server_negotiation.cc:407] Connection header received
0811 15:03:07.534157 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.534159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.534201 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.534297 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.535231 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.535973 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.537028 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.537391 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.537487 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.540618 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.540622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.540625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.540649 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.542890 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.543431 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.543435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.543436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.543524 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.543846 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.543849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.543850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.544110 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.544840 (+ 730us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.545275 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.545405 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":383,"thread_start_us":127,"threads_started":1}
I20260811 15:03:07.547814 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.530439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59402 (local address 127.11.225.124:42293)
0811 15:03:07.530839 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.530855 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.530892 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:03:07.531568 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.531585 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.532013 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.532471 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.532959 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.534362 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.535164 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.535867 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.536033 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.538582 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.538589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.538607 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.538646 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.542206 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.542764 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.542770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.542775 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.542915 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.543258 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.543261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.543263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.543795 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.544716 (+ 921us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.544886 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.545179 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":128,"threads_started":1}
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:03:07.552162 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.539656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45354 (local address 127.11.225.126:36469)
0811 15:03:07.539797 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.539801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.540119 (+ 318us) server_negotiation.cc:407] Connection header received
0811 15:03:07.540284 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.540286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.540335 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.540417 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.541274 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.542330 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.543561 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.543872 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.543978 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.546565 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.546569 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.546571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.546598 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.549802 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.550503 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.550507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.550509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.550608 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.550962 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.550965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.550967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.551285 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.551371 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.551875 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.552001 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":60}
I20260811 15:03:07.552202 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.539567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:36469 (local address 127.0.0.1:45354)
0811 15:03:07.539982 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.540038 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.540168 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.540448 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.540454 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.540981 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.541134 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.541142 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.542453 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.542456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.543435 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.543443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.544145 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.544149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.544258 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.544785 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.544798 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.546410 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.550002 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.550011 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.550017 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.550333 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.550742 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.550747 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.550750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.550852 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.551461 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.551467 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.551606 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.551788 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.551988 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":120,"threads_started":1}
I20260811 15:03:07.552265 18833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: Bootstrap starting.
I20260811 15:03:07.553519 19095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.553697 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.542224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59422)
0811 15:03:07.542339 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.542355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.542444 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.543452 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.543455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.543661 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.543785 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.543796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.545427 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.545430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.546188 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.546200 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.546792 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.546796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.546882 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.547381 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.547396 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.549541 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.551957 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.551961 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.551963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.552217 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.552566 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.552570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.552572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.552668 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.553177 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.553181 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.553314 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.553403 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.553546 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 15:03:07.554399 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.542493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.11.225.124:42293)
0811 15:03:07.543135 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.543143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.543154 (+ 11us) server_negotiation.cc:407] Connection header received
0811 15:03:07.543185 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.543188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.543291 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.543897 (+ 606us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.543996 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.545298 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.546312 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.546647 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.546785 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.549793 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.549796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.549799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.549852 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.551835 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.552355 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.552357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.552359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.552444 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.552802 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.552806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.552808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.553020 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.553993 (+ 973us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.554082 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.554210 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":569,"thread_start_us":124,"threads_started":1}
I20260811 15:03:07.556311 18833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:07.557678 18964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: Bootstrap starting.
I20260811 15:03:07.557435 18833 log.cc:824] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:07.560163 18833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: No bootstrap required, opened a new log
I20260811 15:03:07.560539 18964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:07.561455 18964 log.cc:824] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:07.563028 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.554233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48564 (local address 127.11.225.125:45469)
0811 15:03:07.554373 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.554377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.554632 (+ 255us) server_negotiation.cc:407] Connection header received
0811 15:03:07.554804 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.554808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.554861 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.554912 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.555406 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.555923 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.556776 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.557112 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.557230 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.559371 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.559380 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.559381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.559403 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.560934 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.561439 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.561443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.561445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.561567 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.561977 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.561981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.561982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.562232 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.562311 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.562678 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.562819 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:03:07.563723 18964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: No bootstrap required, opened a new log
I20260811 15:03:07.563892 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.553993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:45469 (local address 127.0.0.1:48564)
0811 15:03:07.554564 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.554578 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.554696 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.555066 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.555068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.555202 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.555287 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.555292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.556038 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.556042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.556657 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.556665 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.557230 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.557234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.557338 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.557905 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.557920 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.559234 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.561047 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.561051 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.561053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.561325 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.561681 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.561684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.561686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.561870 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.562386 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.562389 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.562487 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.563444 (+ 957us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.563620 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514}
I20260811 15:03:07.564424 18833 raft_consensus.cc:348] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.564687 18833 raft_consensus.cc:729] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b551e0b1ab1146088fe1d2c291ae0623, State: Initialized, Role: FOLLOWER
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:03:07.564965 19095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:07.565033 18833 consensus_queue.cc:260] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.566426 18833 sys_catalog.cc:564] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:07.567713 18964 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.567952 18964 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7acd5927f19649449e92eaeb4d7ef4e2, State: Initialized, Role: FOLLOWER
I20260811 15:03:07.568338 18964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.568921 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.550926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45358 (local address 127.11.225.126:36469)
0811 15:03:07.552317 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.552322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.552336 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:07.552369 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.552372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.552410 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.552483 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.553688 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.554412 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.561934 (+ 7522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.562259 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.562346 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.565470 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.565474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.565476 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.565505 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.567010 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.567483 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.567487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.567489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.567572 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.567890 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.567893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.567895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.568187 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.568372 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.568648 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.568765 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1330,"thread_start_us":75,"threads_started":1}
W20260811 15:03:07.572029 19139 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:07.572106 19139 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:07.572513 19118 sys_catalog.cc:455] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.572649 19118 sys_catalog.cc:458] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.572897 19140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.573071 19140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.574255 18964 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:07.573203 18729 master_runner.cc:186] Error getting master registration for 127.11.225.125:45469: OK, instance_id { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" instance_seqno: 1786460587287139 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:03:07.578328 18729 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:07.583891 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.571520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.11.225.125:45469)
0811 15:03:07.571642 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.571646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.572341 (+ 695us) server_negotiation.cc:407] Connection header received
0811 15:03:07.572529 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.572534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.572583 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.572636 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.573579 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.574260 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.575388 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.575721 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.575823 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.579134 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.579141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.579145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.579174 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.581420 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.581940 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.581943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.581945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.582034 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.582341 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.582344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.582346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.582584 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.582788 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.583548 (+ 760us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.583675 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 15:03:07 dist-test-slave-8hhm krb5kdc[18706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:03:07.583698 18847 master_runner.cc:186] Error getting master registration for 127.11.225.124:42293: OK, instance_id { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" instance_seqno: 1786460587525017 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:03:07.587567 18847 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:03:07.590888 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.565450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:42293 (local address 127.0.0.1:59436)
0811 15:03:07.565913 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:07.565928 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:07.566006 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:07.569623 (+ 3617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:07.569628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:07.569780 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:07.569854 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.569883 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.570871 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.570874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.571662 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:07.571673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.578611 (+ 6938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.578615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:07.578717 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.582396 (+ 3679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:07.582412 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:07.584786 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:07.589266 (+ 4480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.589271 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.589275 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.589535 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.589805 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:07.589808 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:07.589810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:07.589876 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:07.590313 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:07.590315 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:07.590416 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 15:03:07.590552 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 15:03:07.590698 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":123,"threads_started":1}
I20260811 15:03:07.591095 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:07.591280 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.569053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59436 (local address 127.11.225.124:42293)
0811 15:03:07.569182 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.569186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.569201 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:07.569266 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.569271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.569325 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.569407 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.570004 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.570745 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.571800 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.572149 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.572228 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.584983 (+ 12755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.584987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.584990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.585015 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.587016 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.589642 (+ 2626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.589646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.589647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.589722 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.589953 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.589956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.589957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.590183 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.590257 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.590638 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.590773 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 15:03:07.592661 18788 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b551e0b1ab1146088fe1d2c291ae0623"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45358
I20260811 15:03:07.593042 18788 raft_consensus.cc:482] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 15:03:07.593189 18788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:07.594832 18788 raft_consensus.cc:504] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.596345 18919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b551e0b1ab1146088fe1d2c291ae0623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7acd5927f19649449e92eaeb4d7ef4e2"
I20260811 15:03:07.596441 18788 leader_election.cc:288] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [CANDIDATE]: Term 1 election: Requested vote from peers 7acd5927f19649449e92eaeb4d7ef4e2 (127.11.225.125:45469), ae509942e31a4813bc0c742b44407bb5 (127.11.225.124:42293)
I20260811 15:03:07.596621 18919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:07.598340 18919 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b551e0b1ab1146088fe1d2c291ae0623 in term 1.
W20260811 15:03:07.600726 19164 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:07.600800 19164 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:07.601398 19095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: Bootstrap starting.
I20260811 15:03:07.603822 18758 leader_election.cc:302] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7acd5927f19649449e92eaeb4d7ef4e2, b551e0b1ab1146088fe1d2c291ae0623; no voters:
I20260811 15:03:07.604225 19118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:07.604497 19118 raft_consensus.cc:686] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [term 1 LEADER]: Becoming Leader. State: Replica: b551e0b1ab1146088fe1d2c291ae0623, State: Running, Role: LEADER
I20260811 15:03:07.604914 19118 consensus_queue.cc:237] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.609272 19177 sys_catalog.cc:455] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b551e0b1ab1146088fe1d2c291ae0623. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.609411 19177 sys_catalog.cc:458] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:07.609961 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.598793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.11.225.125:45469)
0811 15:03:07.598921 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.598928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.599269 (+ 341us) server_negotiation.cc:407] Connection header received
0811 15:03:07.599429 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.599432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.599485 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.599535 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.600599 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.601352 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.602420 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.602804 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.602916 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.605496 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.605500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.605504 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.605543 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.607432 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.608073 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.608078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.608082 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.608171 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.608518 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.608524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.608527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.608778 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.608907 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.609655 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.609776 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:03:07.610216 19095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:07.611423 19095 log.cc:824] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:07.614889 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.599017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45366 (local address 127.11.225.126:36469)
0811 15:03:07.599150 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.599155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.602621 (+ 3466us) server_negotiation.cc:407] Connection header received
0811 15:03:07.602764 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.602768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.602840 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.602915 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.603908 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.604714 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.606029 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.606401 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.606484 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.609891 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.609895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.609898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.609923 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.611943 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.613434 (+ 1491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.613438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.613440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.613534 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.613865 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.613868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.613870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.614107 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.614257 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.614603 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.614727 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:07.620836 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:07.599420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59438 (local address 127.11.225.124:42293)
0811 15:03:07.599538 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.599542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.610953 (+ 11411us) server_negotiation.cc:407] Connection header received
0811 15:03:07.611238 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.611242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.611308 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.611372 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.612723 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.613455 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.615111 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:07.615429 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:07.615517 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:07.617481 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:07.617485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:07.617487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:07.617513 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:07.619125 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.619594 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.619597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.619599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.619686 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:07.619952 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:07.619957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:07.619959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:07.620145 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:07.620298 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:07.620524 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 15:03:07.620641 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:07.627568 19181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:07.628706 19181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:07.629166 19095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: No bootstrap required, opened a new log
I20260811 15:03:07.634300 19095 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.634663 19095 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae509942e31a4813bc0c742b44407bb5, State: Initialized, Role: FOLLOWER
I20260811 15:03:07.635077 19095 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } }
I20260811 15:03:07.635638 19183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.635900 19183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.636574 19095 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:07.637460 19047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b551e0b1ab1146088fe1d2c291ae0623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ae509942e31a4813bc0c742b44407bb5"
I20260811 15:03:07.637770 19047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:07.639427 19047 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b551e0b1ab1146088fe1d2c291ae0623 in term 1.
W20260811 15:03:07.643505 19210 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:07.643630 19210 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:07.645843 18919 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [term 1 FOLLOWER]: Refusing update from remote peer b551e0b1ab1146088fe1d2c291ae0623: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:07.645897 19047 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [term 1 FOLLOWER]: Refusing update from remote peer b551e0b1ab1146088fe1d2c291ae0623: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:07.646771 19118 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:07.647257 19118 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:07.651954 19183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b551e0b1ab1146088fe1d2c291ae0623. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.652057 19140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b551e0b1ab1146088fe1d2c291ae0623. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.652143 19183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.652190 19140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.654969 19177 sys_catalog.cc:455] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.655108 19177 sys_catalog.cc:458] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:07.658052 19209 mvcc.cc:205] Tried to move back new op lower bound from 7317342566988288000 to 7317342566836981760. Current Snapshot: MvccSnapshot[applied={T|T < 7317342566988288000}]
I20260811 15:03:07.658278 19183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.658421 19183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.658658 19118 sys_catalog.cc:455] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.658784 19118 sys_catalog.cc:458] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:07.660180 19140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b551e0b1ab1146088fe1d2c291ae0623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b551e0b1ab1146088fe1d2c291ae0623" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 36469 } } peers { permanent_uuid: "7acd5927f19649449e92eaeb4d7ef4e2" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 45469 } } peers { permanent_uuid: "ae509942e31a4813bc0c742b44407bb5" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 42293 } } }
I20260811 15:03:07.660307 19140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:07.660653 19181 catalog_manager.cc:1347] Generated new cluster ID: 495f30a5b563413bba30bad445ffe698
I20260811 15:03:07.660713 19181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:07.700294 19181 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:07.701843 19181 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:07.723230 19181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b551e0b1ab1146088fe1d2c291ae0623: Generated new TSK 0
I20260811 15:03:07.724404 19181 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:03:07.767560 19106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.765608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.11.225.124:42293)
0811 15:03:07.765740 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.765744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.766396 (+ 652us) server_negotiation.cc:407] Connection header received
0811 15:03:07.766612 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.766615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.766669 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.766722 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.767396 (+ 674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59450: BlockingRecv error: recv got EOF from 127.0.0.1:59450 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 15:03:07.775403 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.773715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48594 (local address 127.11.225.125:45469)
0811 15:03:07.773873 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.773879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.774192 (+ 313us) server_negotiation.cc:407] Connection header received
0811 15:03:07.774336 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.774340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.774400 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.774492 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.775235 (+ 743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48594: BlockingRecv error: recv got EOF from 127.0.0.1:48594 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 15:03:07.776831 18842 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.774873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.11.225.126:36469)
0811 15:03:07.775014 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.775019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.776001 (+ 982us) server_negotiation.cc:407] Connection header received
0811 15:03:07.776126 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.776130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.776192 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.776279 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.776673 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45374: BlockingRecv error: recv got EOF from 127.0.0.1:45374 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 15:03:07.790151 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.779651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48608 (local address 127.11.225.125:45469)
0811 15:03:07.779782 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.779787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.788834 (+ 9047us) server_negotiation.cc:407] Connection header received
0811 15:03:07.789138 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.789142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.789263 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.789333 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.790004 (+ 671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48608: BlockingRecv error: recv got EOF from 127.0.0.1:48608 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 15:03:07.814741 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.798148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48614 (local address 127.11.225.125:45469)
0811 15:03:07.798335 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.798342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.803014 (+ 4672us) server_negotiation.cc:407] Connection header received
0811 15:03:07.813447 (+ 10433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.813455 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.813564 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.813660 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.814565 (+ 905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48614: BlockingRecv error: recv got EOF from 127.0.0.1:48614 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 15:03:07.838792 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.825736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48618 (local address 127.11.225.125:45469)
0811 15:03:07.825869 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.825874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.837627 (+ 11753us) server_negotiation.cc:407] Connection header received
0811 15:03:07.837876 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.837880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.837940 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.837996 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.838660 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48618: BlockingRecv error: recv got EOF from 127.0.0.1:48618 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 15:03:07.862968 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.853840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48628 (local address 127.11.225.125:45469)
0811 15:03:07.854051 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.854056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.861661 (+ 7605us) server_negotiation.cc:407] Connection header received
0811 15:03:07.861958 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.861962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.862050 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.862121 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.862834 (+ 713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48628: BlockingRecv error: recv got EOF from 127.0.0.1:48628 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
W20260811 15:03:07.875783 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.873980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.11.225.125:45469)
0811 15:03:07.874145 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.874151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.874452 (+ 301us) server_negotiation.cc:407] Connection header received
0811 15:03:07.874696 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.874700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.874761 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.874823 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.875658 (+ 835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48644: BlockingRecv error: recv got EOF from 127.0.0.1:48644 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 15:03:07.896235 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.894571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.11.225.125:45469)
0811 15:03:07.894699 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.894703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.895020 (+ 317us) server_negotiation.cc:407] Connection header received
0811 15:03:07.895270 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.895274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.895347 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.895407 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.896103 (+ 696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48652: BlockingRecv error: recv got EOF from 127.0.0.1:48652 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:03:07.932528 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.931023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48654 (local address 127.11.225.125:45469)
0811 15:03:07.931151 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.931156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.931454 (+ 298us) server_negotiation.cc:407] Connection header received
0811 15:03:07.931605 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.931610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.931707 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.931819 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.932355 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48654: BlockingRecv error: recv got EOF from 127.0.0.1:48654 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 15:03:07.999809 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:07.998648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48656 (local address 127.11.225.125:45469)
0811 15:03:07.998796 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:07.998799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:07.999029 (+ 230us) server_negotiation.cc:407] Connection header received
0811 15:03:07.999101 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:07.999104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:07.999158 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:07.999248 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:07.999707 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48656: BlockingRecv error: recv got EOF from 127.0.0.1:48656 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 15:03:08.131600 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:08.130362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48666 (local address 127.11.225.125:45469)
0811 15:03:08.130572 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.130577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.130698 (+ 121us) server_negotiation.cc:407] Connection header received
0811 15:03:08.130813 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.130815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.130865 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.130941 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:08.131446 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48666: BlockingRecv error: recv got EOF from 127.0.0.1:48666 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 15:03:08.391299 18970 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:08.390055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48668 (local address 127.11.225.125:45469)
0811 15:03:08.390239 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.390243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.390318 (+ 75us) server_negotiation.cc:407] Connection header received
0811 15:03:08.390453 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.390455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.390509 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.390591 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:08.391140 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48668: BlockingRecv error: recv got EOF from 127.0.0.1:48668 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 15:03:08.602948 19164 catalog_manager.cc:1259] Loaded cluster ID: 495f30a5b563413bba30bad445ffe698
I20260811 15:03:08.603026 19164 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: loading cluster ID for follower catalog manager: success
I20260811 15:03:08.604941 19164 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: acquiring CA information for follower catalog manager: success
I20260811 15:03:08.606451 19164 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7acd5927f19649449e92eaeb4d7ef4e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:03:08.645123 19210 catalog_manager.cc:1259] Loaded cluster ID: 495f30a5b563413bba30bad445ffe698
I20260811 15:03:08.645289 19210 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: loading cluster ID for follower catalog manager: success
I20260811 15:03:08.647073 19210 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: acquiring CA information for follower catalog manager: success
I20260811 15:03:08.648265 19210 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ae509942e31a4813bc0c742b44407bb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:03:08.909402 19328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:08.905556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48684 (local address 127.11.225.125:45469)
0811 15:03:08.905849 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.905853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.905870 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:08.906048 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.906051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.906185 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.906288 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:08.906520 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.907063 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.907918 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.908159 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.908241 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:08.908520 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:08.908965 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:08.909070 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:08.909122 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 15:03:08.909172 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":101,"threads_started":1}
I20260811 15:03:08.915988 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:08.912581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59466 (local address 127.11.225.124:42293)
0811 15:03:08.912810 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.912814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.912827 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:08.912908 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.912910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.913022 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.913121 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:08.913380 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.913900 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.914669 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.914874 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.914945 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:08.915191 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:08.915606 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:08.915694 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:08.915747 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 15:03:08.915790 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":79,"threads_started":1}
I20260811 15:03:08.923077 19328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:08.919251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.11.225.125:45469)
0811 15:03:08.919373 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.919377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.919391 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:08.919443 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.919446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.919500 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.919597 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:08.919880 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.920602 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.921824 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.922113 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.922220 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:08.922566 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:08.922656 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:08.922745 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:08.922874 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 15:03:08.922931 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:08.923228 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:08.919064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.11.225.124:42293)
0811 15:03:08.919409 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.919414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.919785 (+ 371us) server_negotiation.cc:407] Connection header received
0811 15:03:08.919836 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.919840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.919895 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.919973 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:08.920229 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.920847 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.921905 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.922250 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.922347 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:08.922660 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:08.922740 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:08.922810 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:08.922908 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 15:03:08.922967 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275}
I20260811 15:03:08.923929 19361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:08.919030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45380 (local address 127.11.225.126:36469)
0811 15:03:08.919429 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:08.919436 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:08.919741 (+ 305us) server_negotiation.cc:407] Connection header received
0811 15:03:08.919854 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:08.919857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:08.920011 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:08.920142 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:08.920367 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.921076 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.922205 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:08.922544 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:08.922654 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:08.923073 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:08.923440 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:08.923541 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:08.923705 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 15:03:08.923769 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":76,"threads_started":1}
I20260811 15:03:08.927175 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18729
I20260811 15:03:08.945313 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18847
I20260811 15:03:08.961800 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 18974
2026-08-11T15:03:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3546 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:09 dist-test-slave-8hhm krb5kdc[19372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:09 dist-test-slave-8hhm krb5kdc[19372](info): set up 2 sockets
Aug 11 15:03:09 dist-test-slave-8hhm krb5kdc[19372](info): commencing operation
krb5kdc: starting...
W20260811 15:03:10.296146 12165 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/test-user.keytab.
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.225.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
Entry for principal kudu/127.11.225.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab.
I20260811 15:03:10.429473 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33207
--webserver_interface=127.11.225.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:10.548017 19396 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:10.548310 19396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:10.548334 19396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:10.548425 19396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:10.552397 19396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:10.552464 19396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:10.552484 19396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:10.552500 19396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:10.552516 19396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:10.558570 19396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.126.keytab
--principal=kudu/127.11.225.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.126:33207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.225.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:10.559708 19396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:10.560773 19396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:10.569731 19412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:10.569784 19405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:10.569751 19406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:10.569829 19396 server_base.cc:1034] running on GCE node
I20260811 15:03:10.570643 19396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:10.571758 19396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:10.572970 19396 hybrid_clock.cc:648] HybridClock initialized: now 1786460590572934 us; error 57 us; skew 500 ppm
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:10.578637 19396 init.cc:377] Logged in from keytab as kudu/127.11.225.126@KRBTEST.COM (short username kudu)
I20260811 15:03:10.579550 19396 webserver.cc:460] Webserver started at http://127.11.225.126:34445/ using document root <none> and password file <none>
I20260811 15:03:10.580145 19396 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:10.580242 19396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:10.580494 19396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:10.582659 19396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data/instance:
uuid: "840e242c2488498fb4cd5ffdedfa1a5c"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "41c2eb6942106dbbdc66eaf102b4d0a9"
server_key_iv: "eb9f3f8ab7747123a449fc565697c6ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.583523 19396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance:
uuid: "840e242c2488498fb4cd5ffdedfa1a5c"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "41c2eb6942106dbbdc66eaf102b4d0a9"
server_key_iv: "eb9f3f8ab7747123a449fc565697c6ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.589339 19396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 15:03:10.592484 19423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:10.593922 19396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:10.594036 19396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal
uuid: "840e242c2488498fb4cd5ffdedfa1a5c"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "41c2eb6942106dbbdc66eaf102b4d0a9"
server_key_iv: "eb9f3f8ab7747123a449fc565697c6ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.594127 19396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:10.608697 19396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:10.611544 19396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:10.611712 19396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:10.618875 19396 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.126:33207
I20260811 15:03:10.619182 19503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.126:33207 every 8 connection(s)
I20260811 15:03:10.619935 19396 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:10.622888 19505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:10.626757 19505 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.627379 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19396
I20260811 15:03:10.627522 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-0/wal/instance
I20260811 15:03:10.627869 12165 external_mini_cluster.cc:1428] Setting key 6be8c143683a4791f64cc0db289efa83
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.125@KRBTEST.COM" created.
I20260811 15:03:10.643713 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.629251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33207 (local address 127.0.0.1:54698)
0811 15:03:10.629731 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.629784 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:10.630613 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:10.631527 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:10.631531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:10.631887 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:10.632178 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.632192 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.634103 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.634105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.634803 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.634811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.635853 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.635856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.636016 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.636693 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:10.636710 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:10.638615 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:10.640672 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.640681 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.640691 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.640918 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.641349 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.641351 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.641352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.641467 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.642209 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:10.642217 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:10.642362 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 15:03:10.642537 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 15:03:10.642835 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":69,"spinlock_wait_cycles":2176,"thread_start_us":127,"threads_started":1}
I20260811 15:03:10.643716 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.629243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54698 (local address 127.11.225.126:33207)
0811 15:03:10.629860 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:10.629875 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:10.629926 (+ 51us) server_negotiation.cc:407] Connection header received
0811 15:03:10.630988 (+ 1062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:10.630996 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:10.631272 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:10.631518 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:10.632381 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.633958 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.634938 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.635686 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.635905 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.638831 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:10.638842 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:10.638859 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:10.638894 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:10.640558 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.641068 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.641074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.641076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.641199 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.641584 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.641588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.641589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.642061 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:10.642221 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:10.642665 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 15:03:10.642942 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":462,"spinlock_wait_cycles":12928,"thread_start_us":184,"threads_started":1}
I20260811 15:03:10.646584 19505 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.647361 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.647097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36820)
0811 15:03:10.647222 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.647299 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 15:03:10.647632 19429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
I20260811 15:03:10.648535 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.648320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36828)
0811 15:03:10.648428 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.648482 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:03:10.648699 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:44375: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
Entry for principal kudu/127.11.225.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab.
I20260811 15:03:10.660431 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:44375
--webserver_interface=127.11.225.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:10.697901 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } attempt: 1
I20260811 15:03:10.698866 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.698482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36834)
0811 15:03:10.698683 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.698762 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 15:03:10.699710 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.699451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36850)
0811 15:03:10.699581 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.699638 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 15:03:10.699857 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:44375: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
I20260811 15:03:10.768144 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } attempt: 2
I20260811 15:03:10.769084 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.768736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36866)
0811 15:03:10.768899 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.769003 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 15:03:10.769908 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.769689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36876)
0811 15:03:10.769802 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.769854 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 15:03:10.770069 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.125:44375: Network error: Client connection negotiation failed: client connection to 127.11.225.125:44375: connect: Connection refused (error 111)
W20260811 15:03:10.778962 19517 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:10.779279 19517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:10.779345 19517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:10.779422 19517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:10.783468 19517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:10.783550 19517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:10.783595 19517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:10.783651 19517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:10.783689 19517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:10.789093 19517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.125.keytab
--principal=kudu/127.11.225.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.125:44375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.225.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:10.790264 19517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:10.791358 19517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:10.800590 19526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:10.800673 19530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:10.800590 19527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:10.800716 19517 server_base.cc:1034] running on GCE node
I20260811 15:03:10.801527 19517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:10.802613 19517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:10.803814 19517 hybrid_clock.cc:648] HybridClock initialized: now 1786460590803799 us; error 28 us; skew 500 ppm
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:10.806819 19517 init.cc:377] Logged in from keytab as kudu/127.11.225.125@KRBTEST.COM (short username kudu)
I20260811 15:03:10.807744 19517 webserver.cc:460] Webserver started at http://127.11.225.125:36387/ using document root <none> and password file <none>
I20260811 15:03:10.808331 19517 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:10.808436 19517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:10.808709 19517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:10.810868 19517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data/instance:
uuid: "ff606f19ec704c25bd16d3c242378f67"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "9edf575fee2e838db456ccdd70e28b28"
server_key_iv: "b411f9cd14863a16f46892dc638a8ff0"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.811468 19517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal/instance:
uuid: "ff606f19ec704c25bd16d3c242378f67"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "9edf575fee2e838db456ccdd70e28b28"
server_key_iv: "b411f9cd14863a16f46892dc638a8ff0"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.815488 19517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:10.818040 19539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:10.819289 19517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:10.819440 19517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal
uuid: "ff606f19ec704c25bd16d3c242378f67"
format_stamp: "Formatted at 2026-08-11 15:03:10 on dist-test-slave-8hhm"
server_key: "9edf575fee2e838db456ccdd70e28b28"
server_key_iv: "b411f9cd14863a16f46892dc638a8ff0"
server_key_version: "encryptionkey@0"
I20260811 15:03:10.819587 19517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:10.839726 19517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:10.843262 19517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:10.843483 19517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:10.850996 19517 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.125:44375
I20260811 15:03:10.851306 19633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.125:44375 every 8 connection(s)
I20260811 15:03:10.852142 19517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/data/info.pb
I20260811 15:03:10.855077 19634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:10.859125 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19517
I20260811 15:03:10.859303 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-1/wal/instance
I20260811 15:03:10.859220 19634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.859659 12165 external_mini_cluster.cc:1428] Setting key b4f57d75c404a9a79e7ce6f75ac8a102
I20260811 15:03:10.861259 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } attempt: 3
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.225.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.225.124@KRBTEST.COM" created.
I20260811 15:03:10.875747 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.861785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36878)
0811 15:03:10.862000 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.862016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:10.862115 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:10.863871 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:10.863874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:10.864102 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:10.864226 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.864234 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.865713 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.865720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.866787 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.866804 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.867720 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.867727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.868025 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.868682 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:10.868700 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:10.870706 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:10.873295 (+ 2589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.873300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.873302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.873587 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.874038 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.874041 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.874043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.874149 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.875045 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:10.875051 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:10.875183 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 15:03:10.875277 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 15:03:10.875443 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":63}
I20260811 15:03:10.876206 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.861379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54712 (local address 127.11.225.126:33207)
0811 15:03:10.861535 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:10.861542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:10.862628 (+ 1086us) server_negotiation.cc:407] Connection header received
0811 15:03:10.863662 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:10.863669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:10.863743 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:10.863848 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:10.865092 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.865803 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.866867 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.867994 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.868111 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.871926 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:10.871930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:10.871932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:10.871955 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:10.873796 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.874475 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.874482 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.874484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.874584 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.874889 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.874893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.874895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.875090 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:10.875204 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:10.875646 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 15:03:10.875774 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":61}
I20260811 15:03:10.876965 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.861896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.11.225.125:44375)
0811 15:03:10.862515 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:10.862530 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:10.862570 (+ 40us) server_negotiation.cc:407] Connection header received
0811 15:03:10.863396 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:10.863423 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:10.863703 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:10.863882 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:10.864337 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.865569 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.866922 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.867563 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.867735 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.870893 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:10.870901 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:10.870915 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:10.870943 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:10.873081 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.873720 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.873728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.873735 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.873885 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.874268 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.874275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.874279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.874901 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:10.876142 (+ 1241us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:10.876242 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 15:03:10.876422 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"spinlock_wait_cycles":68480,"thread_start_us":205,"threads_started":1}
I20260811 15:03:10.876963 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.861886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33207 (local address 127.0.0.1:54712)
0811 15:03:10.862462 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.862515 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:10.863400 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:10.864065 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:10.864074 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:10.864635 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:10.864917 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.864936 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.865923 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.865926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.866729 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.866739 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.868157 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.868161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.868312 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.868877 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:10.868900 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:10.871719 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:10.873975 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.873984 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.874010 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.874364 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.874689 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.874693 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.874695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.874789 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.875219 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:10.875228 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:10.875379 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 15:03:10.875571 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 15:03:10.875941 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":179,"threads_started":1}
I20260811 15:03:10.878616 19634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.879297 19505 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.880076 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.879826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59922)
0811 15:03:10.879945 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.880002 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
Aug 11 15:03:10 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:10.888046 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.886602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59928)
0811 15:03:10.887876 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.887947 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1110}
W20260811 15:03:10.888264 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:10.889595 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.879182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36886)
0811 15:03:10.879390 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.879408 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:10.879494 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:10.879850 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:10.879853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:10.880037 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:10.880146 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.880153 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.881111 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.881117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.882117 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:10.882132 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.882818 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.882823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:10.882931 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.883421 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:10.883438 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:10.885338 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:10.887747 (+ 2409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.887754 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.887776 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.888062 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.888413 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:10.888419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:10.888425 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:10.888518 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:10.888994 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:10.888997 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:10.889102 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 15:03:10.889266 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 15:03:10.889413 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 15:03:10.890089 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.879229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.11.225.125:44375)
0811 15:03:10.879671 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:10.879674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:10.879685 (+ 11us) server_negotiation.cc:407] Connection header received
0811 15:03:10.879713 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:10.879715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:10.879746 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:10.879839 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:10.880263 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.880985 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.882268 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:10.882694 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:10.883170 (+ 476us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:10.885489 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:10.885495 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:10.885501 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:10.885539 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:10.887616 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.888194 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.888200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.888205 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.888296 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:10.888655 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:10.888657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:10.888659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:10.888866 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:10.888979 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:10.889821 (+ 842us) server_negotiation.cc:299] Negotiation successful
0811 15:03:10.889928 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377}
I20260811 15:03:10.891870 19634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:10.892735 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.892434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59934)
0811 15:03:10.892556 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.892665 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 15:03:10.893467 19548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:10.897550 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.896067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59948)
0811 15:03:10.897354 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.897413 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1183}
W20260811 15:03:10.897728 19634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
Entry for principal kudu/127.11.225.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab.
I20260811 15:03:10.904897 12165 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
/tmp/dist-test-tasknb3eKX/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:40459
--webserver_interface=127.11.225.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.225.84:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:10.919407 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 1
I20260811 15:03:10.920441 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.920104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59956)
0811 15:03:10.920281 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.920355 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 15:03:10.921386 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.921134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59966)
0811 15:03:10.921267 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.921318 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 15:03:10.921578 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:10.947033 19634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 1
I20260811 15:03:10.948046 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.947692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59970)
0811 15:03:10.947874 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.947950 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 15:03:10.948848 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.948610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59976)
0811 15:03:10.948721 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.948775 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:03:10.949018 19634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:10.996739 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 2
I20260811 15:03:10.997690 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.997397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:59986)
0811 15:03:10.997537 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.997611 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 15:03:10.998581 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:10.998349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60000)
0811 15:03:10.998480 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:10.998531 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 15:03:10.998734 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:11.017220 19634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 2
I20260811 15:03:11.018136 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.017781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60014)
0811 15:03:11.017959 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.018034 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 15:03:11.018884 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.018657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60030)
0811 15:03:11.018771 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.018822 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 15:03:11.019039 19634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
W20260811 15:03:11.030310 19645 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:03:11.030630 19645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:11.030701 19645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:11.030792 19645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:11.034830 19645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:11.034905 19645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:11.034941 19645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:11.035000 19645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:11.035038 19645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:11.040246 19645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.225.84:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.225.126:33207,127.11.225.125:44375,127.11.225.124:40459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/krb5kdc/kudu_127.11.225.124.keytab
--principal=kudu/127.11.225.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.225.124:40459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.225.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:11.041420 19645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:11.042477 19645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:11.051352 19654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:11.051353 19659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:11.051426 19653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:11.051640 19645 server_base.cc:1034] running on GCE node
I20260811 15:03:11.052237 19645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:11.053514 19645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:11.054718 19645 hybrid_clock.cc:648] HybridClock initialized: now 1786460591054676 us; error 54 us; skew 500 ppm
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460591, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:11.057837 19645 init.cc:377] Logged in from keytab as kudu/127.11.225.124@KRBTEST.COM (short username kudu)
I20260811 15:03:11.058768 19645 webserver.cc:460] Webserver started at http://127.11.225.124:33383/ using document root <none> and password file <none>
I20260811 15:03:11.059506 19645 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:11.059602 19645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:11.059824 19645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:11.062032 19645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data/instance:
uuid: "d02631cf2b15417ebe9e2ca1f881148e"
format_stamp: "Formatted at 2026-08-11 15:03:11 on dist-test-slave-8hhm"
server_key: "27c594c872961b0baf58eff079526962"
server_key_iv: "d50d9dd2817a91be67e0265115b6f14a"
server_key_version: "encryptionkey@0"
I20260811 15:03:11.062695 19645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal/instance:
uuid: "d02631cf2b15417ebe9e2ca1f881148e"
format_stamp: "Formatted at 2026-08-11 15:03:11 on dist-test-slave-8hhm"
server_key: "27c594c872961b0baf58eff079526962"
server_key_iv: "d50d9dd2817a91be67e0265115b6f14a"
server_key_version: "encryptionkey@0"
I20260811 15:03:11.066584 19645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:11.069124 19669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:11.070413 19645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:11.070560 19645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data,/tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal
uuid: "d02631cf2b15417ebe9e2ca1f881148e"
format_stamp: "Formatted at 2026-08-11 15:03:11 on dist-test-slave-8hhm"
server_key: "27c594c872961b0baf58eff079526962"
server_key_iv: "d50d9dd2817a91be67e0265115b6f14a"
server_key_version: "encryptionkey@0"
I20260811 15:03:11.070675 19645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:11.092851 19645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:11.096186 19645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:11.096405 19645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:11.097899 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 3
I20260811 15:03:11.098667 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.098399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60032)
0811 15:03:11.098528 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.098593 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 15:03:11.099308 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.099100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60040)
0811 15:03:11.099205 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.099249 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 15:03:11.099452 19505 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.225.124:40459: Network error: Client connection negotiation failed: client connection to 127.11.225.124:40459: connect: Connection refused (error 111)
I20260811 15:03:11.104017 19645 rpc_server.cc:307] RPC server started. Bound to: 127.11.225.124:40459
I20260811 15:03:11.104307 19748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.225.124:40459 every 8 connection(s)
I20260811 15:03:11.104998 19645 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/data/info.pb
I20260811 15:03:11.107863 19749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:11.110236 19634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 3
I20260811 15:03:11.112084 19749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:11.113917 12165 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu as pid 19645
I20260811 15:03:11.114099 12165 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasknb3eKX/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460289406450-12165-0/minicluster-data/master-2/wal/instance
I20260811 15:03:11.114459 12165 external_mini_cluster.cc:1428] Setting key 0defbee258bc31218572c5da53784348
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.125@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460591, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:03:11.125463 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.110799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60048)
0811 15:03:11.110985 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.111006 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:11.111121 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:11.113722 (+ 2601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:11.113744 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:11.113979 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:11.114138 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.114150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.116045 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.116051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.116929 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.116940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.118063 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.118067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.118155 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.118733 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:11.118745 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:11.120379 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:11.123097 (+ 2718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.123102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.123105 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.123333 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.123725 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.123728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.123730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.123886 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.124714 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:11.124719 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:11.124859 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 15:03:11.124995 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 15:03:11.125185 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 15:03:11.126160 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.114659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.11.225.126:33207)
0811 15:03:11.114788 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.114792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.115210 (+ 418us) server_negotiation.cc:407] Connection header received
0811 15:03:11.115451 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.115454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.115505 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.115575 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.116426 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.116931 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.117947 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.118284 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.118389 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.121675 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.121680 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.121683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.121713 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.123404 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.124094 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.124101 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.124104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.124214 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.124807 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.124810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.124812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.124995 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.125120 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.125885 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.126009 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:03:11.126767 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.114612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.126:33207 (local address 127.0.0.1:54714)
0811 15:03:11.115086 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.115134 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:11.115325 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:11.115770 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:11.115776 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:11.116208 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:11.116302 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.116308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.117053 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.117059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.117804 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.117814 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.118785 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.118789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.118904 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.119513 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:11.119528 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:11.121529 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:11.123514 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.123526 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.123547 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.123915 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.124566 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.124570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.124572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.124664 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.125120 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:11.125128 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:11.125321 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 15:03:11.126353 (+ 1032us) client_negotiation.cc:240] Negotiation successful
0811 15:03:11.126556 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":30,"thread_start_us":117,"threads_started":1}
I20260811 15:03:11.126767 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.111553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.11.225.124:40459)
0811 15:03:11.112019 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.112050 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.112094 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:03:11.112891 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.112918 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.113392 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.113762 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.114346 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.115897 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.117094 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.117915 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.118127 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.120538 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.120545 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.120566 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.120591 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.122975 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.123457 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.123465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.123471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.123623 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.123993 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.123998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.123999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.124566 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.124693 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.125389 (+ 696us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.125716 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":321,"thread_start_us":144,"threads_started":1}
I20260811 15:03:11.128257 19749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:11.128779 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.115511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60052 (local address 127.11.225.124:40459)
0811 15:03:11.115817 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.115825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.115836 (+ 11us) server_negotiation.cc:407] Connection header received
0811 15:03:11.115862 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.115864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.115905 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.115995 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.117094 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.118006 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.119243 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.119637 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.119761 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.123962 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.123968 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.123971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.123999 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.126704 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.127283 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.127289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.127292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.127407 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.127790 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.127792 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.127793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.127986 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.128195 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.128430 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.128566 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":98,"server-negotiator.queue_time_us":248,"thread_start_us":101,"threads_started":1}
I20260811 15:03:11.131842 19634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: Bootstrap starting.
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460591, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:11.134713 19634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: Neither blocks nor log segments found. Creating new log.
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.126@KRBTEST.COM
I20260811 15:03:11.135615 19634 log.cc:824] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:11.137892 19634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: No bootstrap required, opened a new log
I20260811 15:03:11.138931 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.128731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.125:44375 (local address 127.0.0.1:36888)
0811 15:03:11.129125 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.129140 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:11.129242 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:11.129622 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:11.129628 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:11.129793 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:11.129896 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.129902 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.130890 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.130893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.131664 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.131674 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.132260 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.132263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.132354 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.133188 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:11.133205 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:11.134801 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:11.137094 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.137098 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.137103 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.137390 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.137764 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.137767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.137769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.137870 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.138387 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:11.138390 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:11.138495 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 15:03:11.138638 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 15:03:11.138773 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323}
I20260811 15:03:11.139019 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.128954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36888 (local address 127.11.225.125:44375)
0811 15:03:11.129310 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.129316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.129337 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:03:11.129381 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.129384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.129439 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.129599 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.130026 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.130748 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.131787 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.132139 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.132240 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.134938 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.134942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.134944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.134969 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.136977 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.137526 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.137530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.137532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.137647 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.137992 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.137996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.137997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.138275 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.138383 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.138734 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.138853 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260811 15:03:11.140110 19749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:11.140651 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.130082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54726 (local address 127.11.225.126:33207)
0811 15:03:11.130186 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.130191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.130229 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:03:11.130378 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.130381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.130421 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.130516 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.131121 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.131599 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.132631 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.132941 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.133050 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.136178 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.136187 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.136189 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.136210 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.138475 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.138942 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.138946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.138948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.139026 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.139399 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.139402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.139404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.139682 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.139920 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.140244 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.140366 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:11.142263 19634 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.142520 19634 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff606f19ec704c25bd16d3c242378f67, State: Initialized, Role: FOLLOWER
I20260811 15:03:11.142879 19634 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.143416 19766 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.143651 19766 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.144359 19634 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460591, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.124@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.225.125@KRBTEST.COM
I20260811 15:03:11.150110 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.140585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60062)
0811 15:03:11.140690 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.140704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:11.140780 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:11.141397 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:11.141400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:11.141564 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:11.141662 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.141667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.142622 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.142628 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.143394 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.143405 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.143966 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.143970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.144049 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.144525 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:11.144550 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:11.146320 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:11.148430 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.148432 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.148434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.148728 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.149006 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.149009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.149010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.149088 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.149610 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:11.149615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:11.149707 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 15:03:11.149807 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 15:03:11.149942 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 15:03:11.150679 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.140701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60062 (local address 127.11.225.124:40459)
0811 15:03:11.141004 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.141008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.141021 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:11.141055 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.141057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.141099 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.141172 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.141774 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.142489 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.143519 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.143849 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.143950 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.146488 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.146492 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.146495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.146522 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.148323 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.148838 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.148843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.148845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.148915 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.149178 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.149181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.149183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.149473 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.149562 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.150420 (+ 858us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.150530 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233}
I20260811 15:03:11.151466 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.142004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.11.225.125:44375)
0811 15:03:11.142101 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.142105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.142117 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:03:11.142151 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.142153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.142190 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.142270 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.143011 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.143701 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.144563 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.144794 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.144900 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.147639 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.147644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.147648 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.147672 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.149320 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.149785 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.149791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.149795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.149876 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.150179 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.150184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.150186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.150390 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.150554 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.151205 (+ 651us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.151317 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:03:11.148406 19517 master_runner.cc:186] Error getting master registration for 127.11.225.126:33207: OK, instance_id { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" instance_seqno: 1786460590616866 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:03:11.152335 19517 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 15:03:11.153697 19790 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:11.153771 19790 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:11.154093 19749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: Bootstrap starting.
I20260811 15:03:11.156909 19749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:11.157847 19749 log.cc:824] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:11.159163 12165 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:11.160060 19749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: No bootstrap required, opened a new log
I20260811 15:03:11.160496 19467 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "840e242c2488498fb4cd5ffdedfa1a5c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54726
I20260811 15:03:11.164187 19749 raft_consensus.cc:348] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.164424 19749 raft_consensus.cc:729] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02631cf2b15417ebe9e2ca1f881148e, State: Initialized, Role: FOLLOWER
I20260811 15:03:11.164760 19749 consensus_queue.cc:260] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.165259 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.165400 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.166195 19749 sys_catalog.cc:564] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:03:11.172072 19815 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:11.172158 19815 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:11.170204 19645 master_runner.cc:186] Error getting master registration for 127.11.225.126:33207: OK, instance_id { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" instance_seqno: 1786460590616866 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:03:11.172716 19645 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:03:11.263652 19505 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } attempt: 4
Aug 11 15:03:11 dist-test-slave-8hhm krb5kdc[19372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.225.126@KRBTEST.COM for kudu/127.11.225.124@KRBTEST.COM
I20260811 15:03:11.276503 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.264407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.11.225.124:40459)
0811 15:03:11.264541 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.264546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.264735 (+ 189us) server_negotiation.cc:407] Connection header received
0811 15:03:11.264881 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.264884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.264939 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.265012 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.265568 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.266357 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.267226 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.267575 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.268035 (+ 460us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.272992 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.272996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.272998 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.273031 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.274782 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.275212 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.275217 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.275221 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.275313 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.275640 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.275643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.275645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.275831 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.275943 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.276224 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.276340 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:11.276503 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.264347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.225.124:40459 (local address 127.0.0.1:60076)
0811 15:03:11.264586 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:11.264609 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:11.264774 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:11.265034 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:11.265037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:11.265334 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:11.265431 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.265437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.266465 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.266468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.267107 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:11.267117 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.270438 (+ 3321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.270454 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:11.270599 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.271194 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:11.271209 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:11.272850 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:11.274890 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.274894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.274896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.275108 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.275418 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:11.275422 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:11.275424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:11.275519 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:11.275936 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:11.275939 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:11.276050 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 15:03:11.276164 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 15:03:11.276315 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260811 15:03:11.280403 19505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: Bootstrap starting.
I20260811 15:03:11.283360 19505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:11.284271 19505 log.cc:824] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:11.286499 19505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: No bootstrap required, opened a new log
I20260811 15:03:11.289690 19505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.289923 19505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840e242c2488498fb4cd5ffdedfa1a5c, State: Initialized, Role: FOLLOWER
I20260811 15:03:11.290268 19505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.290825 19820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.291107 19820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.291744 19505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:11.291790 19467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 15:03:11.291884 19467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:11.293385 19467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.294490 19467 leader_election.cc:288] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [CANDIDATE]: Term 1 election: Requested vote from peers ff606f19ec704c25bd16d3c242378f67 (127.11.225.125:44375), d02631cf2b15417ebe9e2ca1f881148e (127.11.225.124:40459)
I20260811 15:03:11.295158 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ff606f19ec704c25bd16d3c242378f67"
I20260811 15:03:11.295421 19596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:11.295539 19705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d02631cf2b15417ebe9e2ca1f881148e"
I20260811 15:03:11.295785 19705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:11.296818 19596 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840e242c2488498fb4cd5ffdedfa1a5c in term 1.
I20260811 15:03:11.297104 19705 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840e242c2488498fb4cd5ffdedfa1a5c in term 1.
I20260811 15:03:11.297370 19429 leader_election.cc:302] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 840e242c2488498fb4cd5ffdedfa1a5c, ff606f19ec704c25bd16d3c242378f67; no voters:
I20260811 15:03:11.300613 19820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:11.301304 19820 raft_consensus.cc:686] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [term 1 LEADER]: Becoming Leader. State: Replica: 840e242c2488498fb4cd5ffdedfa1a5c, State: Running, Role: LEADER
I20260811 15:03:11.301659 19820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } }
I20260811 15:03:11.303929 19820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 840e242c2488498fb4cd5ffdedfa1a5c. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.304051 19820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:11.306128 19836 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:11.306255 19836 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:11.313290 19850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:11.314615 19850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:11.316749 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.299335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36912 (local address 127.11.225.125:44375)
0811 15:03:11.299450 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.299455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.306622 (+ 7167us) server_negotiation.cc:407] Connection header received
0811 15:03:11.306838 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.306842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.306895 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.306953 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.308044 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.308775 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.310067 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.310336 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.310397 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.312853 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.312857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.312860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.312887 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.314777 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.315340 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.315344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.315346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.315442 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.315764 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.315767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.315769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.315981 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.316100 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.316477 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.316599 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:03:11.327745 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.304970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60082 (local address 127.11.225.124:40459)
0811 15:03:11.305309 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.305314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.317832 (+ 12518us) server_negotiation.cc:407] Connection header received
0811 15:03:11.318243 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.318246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.318300 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.318354 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.319129 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.319917 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.321111 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.321473 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.321549 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.323671 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.323677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.323680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.323710 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.325621 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.326218 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.326223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.326225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.326316 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.326666 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.326669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.326671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.326908 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.327047 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.327435 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.327572 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260811 15:03:11.329198 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:11.299324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.11.225.126:33207)
0811 15:03:11.299450 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.299455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.317943 (+ 18488us) server_negotiation.cc:407] Connection header received
0811 15:03:11.319171 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.319175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.319227 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.319277 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.320323 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.321062 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.322144 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:11.322512 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:11.322616 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:11.324788 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:11.324795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:11.324799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:11.324836 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:11.326682 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.327159 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.327162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.327164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.327250 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:11.327563 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:11.327577 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:11.327579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:11.327788 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:11.327916 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:11.328921 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0811 15:03:11.329047 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:11.338825 19596 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [term 1 FOLLOWER]: Refusing update from remote peer 840e242c2488498fb4cd5ffdedfa1a5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:11.339749 19820 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:11.341423 19705 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [term 1 FOLLOWER]: Refusing update from remote peer 840e242c2488498fb4cd5ffdedfa1a5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:11.342094 19820 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 15:03:11.345117 19551 tablet.cc:2369] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:11.347872 19678 tablet.cc:2369] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:11.351466 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 840e242c2488498fb4cd5ffdedfa1a5c. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.351610 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.352669 19766 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 840e242c2488498fb4cd5ffdedfa1a5c. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.352774 19766 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.360252 19855 mvcc.cc:205] Tried to move back new op lower bound from 7317342582092353536 to 7317342581976870912. Current Snapshot: MvccSnapshot[applied={T|T < 7317342582092353536}]
I20260811 15:03:11.361522 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.361665 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.359707 19820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.363739 19820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:11.363942 19858 mvcc.cc:205] Tried to move back new op lower bound from 7317342582092353536 to 7317342581976870912. Current Snapshot: MvccSnapshot[applied={T|T < 7317342582092353536}]
I20260811 15:03:11.366381 19820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.366497 19820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:11.367260 19850 catalog_manager.cc:1347] Generated new cluster ID: 7611b221289e433788bca01239f9ca0d
I20260811 15:03:11.367318 19850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:11.367810 19766 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840e242c2488498fb4cd5ffdedfa1a5c" member_type: VOTER last_known_addr { host: "127.11.225.126" port: 33207 } } peers { permanent_uuid: "ff606f19ec704c25bd16d3c242378f67" member_type: VOTER last_known_addr { host: "127.11.225.125" port: 44375 } } peers { permanent_uuid: "d02631cf2b15417ebe9e2ca1f881148e" member_type: VOTER last_known_addr { host: "127.11.225.124" port: 40459 } } }
I20260811 15:03:11.367924 19766 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:11.368494 19856 mvcc.cc:205] Tried to move back new op lower bound from 7317342582092353536 to 7317342581976870912. Current Snapshot: MvccSnapshot[applied={T|T < 7317342582092353536}]
I20260811 15:03:11.405884 19850 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:11.407218 19850 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:11.414412 19850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 840e242c2488498fb4cd5ffdedfa1a5c: Generated new TSK 0
I20260811 15:03:11.415159 19850 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:03:11.439260 19510 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.437578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45982 (local address 127.11.225.126:33207)
0811 15:03:11.437716 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.437720 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.438215 (+ 495us) server_negotiation.cc:407] Connection header received
0811 15:03:11.438406 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.438409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.438460 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.438523 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.439129 (+ 606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45982: BlockingRecv error: recv got EOF from 127.0.0.1:45982 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 15:03:11.439272 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.437624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43576 (local address 127.11.225.125:44375)
0811 15:03:11.437744 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.437748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.438081 (+ 333us) server_negotiation.cc:407] Connection header received
0811 15:03:11.438305 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.438309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.438362 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.438421 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.439138 (+ 717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43576: BlockingRecv error: recv got EOF from 127.0.0.1:43576 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:03:11.440171 19754 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.438322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.11.225.124:40459)
0811 15:03:11.438444 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.438448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.438951 (+ 503us) server_negotiation.cc:407] Connection header received
0811 15:03:11.439134 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.439137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.439187 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.439237 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.440052 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36580: BlockingRecv error: recv got EOF from 127.0.0.1:36580 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:03:11.443374 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.442379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.11.225.125:44375)
0811 15:03:11.442517 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.442521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.442640 (+ 119us) server_negotiation.cc:407] Connection header received
0811 15:03:11.442755 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.442758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.442827 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.442904 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.443281 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43580: BlockingRecv error: recv got EOF from 127.0.0.1:43580 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 15:03:11.447219 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.446383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43584 (local address 127.11.225.125:44375)
0811 15:03:11.446520 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.446524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.446538 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:11.446583 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.446585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.446631 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.446705 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.447121 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43584: BlockingRecv error: recv got EOF from 127.0.0.1:43584 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 15:03:11.452005 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.450836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43596 (local address 127.11.225.125:44375)
0811 15:03:11.450951 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.450955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.451084 (+ 129us) server_negotiation.cc:407] Connection header received
0811 15:03:11.451166 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.451169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.451261 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.451339 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.451904 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43596: BlockingRecv error: recv got EOF from 127.0.0.1:43596 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 15:03:11.460387 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.459144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43606 (local address 127.11.225.125:44375)
0811 15:03:11.459296 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.459299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.459402 (+ 103us) server_negotiation.cc:407] Connection header received
0811 15:03:11.459580 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.459583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.459631 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.459697 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.460264 (+ 567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43606: BlockingRecv error: recv got EOF from 127.0.0.1:43606 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 15:03:11.471583 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.470469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43618 (local address 127.11.225.125:44375)
0811 15:03:11.470608 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.470615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.470752 (+ 137us) server_negotiation.cc:407] Connection header received
0811 15:03:11.470866 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.470870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.470929 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.471032 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.471447 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43618: BlockingRecv error: recv got EOF from 127.0.0.1:43618 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 15:03:11.490895 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.489550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43628 (local address 127.11.225.125:44375)
0811 15:03:11.489707 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.489710 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.489892 (+ 182us) server_negotiation.cc:407] Connection header received
0811 15:03:11.490025 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.490027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.490075 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.490146 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.490736 (+ 590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43628: BlockingRecv error: recv got EOF from 127.0.0.1:43628 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 15:03:11.526468 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.525319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43640 (local address 127.11.225.125:44375)
0811 15:03:11.525465 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.525471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.525606 (+ 135us) server_negotiation.cc:407] Connection header received
0811 15:03:11.525736 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.525738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.525790 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.525865 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.526330 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43640: BlockingRecv error: recv got EOF from 127.0.0.1:43640 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:03:11.594102 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.592828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43648 (local address 127.11.225.125:44375)
0811 15:03:11.593012 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.593016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.593036 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:11.593196 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.593198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.593292 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.593376 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.593916 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43648: BlockingRecv error: recv got EOF from 127.0.0.1:43648 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 15:03:11.725792 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.724459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43662 (local address 127.11.225.125:44375)
0811 15:03:11.724648 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.724653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.724799 (+ 146us) server_negotiation.cc:407] Connection header received
0811 15:03:11.724982 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.724987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.725044 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.725144 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.725659 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43662: BlockingRecv error: recv got EOF from 127.0.0.1:43662 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 15:03:11.985100 19640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:11.984037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.11.225.125:44375)
0811 15:03:11.984212 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:11.984215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:11.984235 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:11.984391 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:11.984393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:11.984442 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:11.984516 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:11.984971 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43672: BlockingRecv error: recv got EOF from 127.0.0.1:43672 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 15:03:12.155222 19790 catalog_manager.cc:1259] Loaded cluster ID: 7611b221289e433788bca01239f9ca0d
I20260811 15:03:12.155323 19790 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: loading cluster ID for follower catalog manager: success
I20260811 15:03:12.157128 19790 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: acquiring CA information for follower catalog manager: success
I20260811 15:03:12.158380 19790 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ff606f19ec704c25bd16d3c242378f67: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:03:12.173602 19815 catalog_manager.cc:1259] Loaded cluster ID: 7611b221289e433788bca01239f9ca0d
I20260811 15:03:12.173692 19815 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: loading cluster ID for follower catalog manager: success
I20260811 15:03:12.175503 19815 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: acquiring CA information for follower catalog manager: success
I20260811 15:03:12.176748 19815 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d02631cf2b15417ebe9e2ca1f881148e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:03:12.503773 19979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:12.499609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43676 (local address 127.11.225.125:44375)
0811 15:03:12.499902 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:12.499906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:12.499925 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:03:12.500137 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:12.500140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:12.500287 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:12.500412 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:12.500695 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.501301 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.502203 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.502437 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.502559 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:12.502903 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:12.503364 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:12.503515 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:12.503550 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 15:03:12.503609 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
I20260811 15:03:12.511031 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:12.507067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.11.225.124:40459)
0811 15:03:12.507359 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:12.507363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:12.507378 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:12.507461 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:12.507464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:12.507589 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:12.507693 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:12.507978 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.508561 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.509471 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.509722 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.509811 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:12.510114 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:12.510574 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:12.510675 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:12.510846 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 15:03:12.510905 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260811 15:03:12.518309 19979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:12.514004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43690 (local address 127.11.225.125:44375)
0811 15:03:12.514139 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:12.514144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:12.514709 (+ 565us) server_negotiation.cc:407] Connection header received
0811 15:03:12.514811 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:12.514813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:12.514889 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:12.514961 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:12.515306 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.515910 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517010 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.517387 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517481 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:12.517775 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:12.517858 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:12.517914 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:12.518082 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 15:03:12.518146 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 15:03:12.518658 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:12.514435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36600 (local address 127.11.225.124:40459)
0811 15:03:12.514551 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:12.514555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:12.514903 (+ 348us) server_negotiation.cc:407] Connection header received
0811 15:03:12.515021 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:12.515026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:12.515081 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:12.515151 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:12.515455 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.516225 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517322 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.517632 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517746 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:12.518030 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:12.518118 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:12.518184 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:12.518336 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 15:03:12.518503 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 15:03:12.519560 20010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:12.514162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45990 (local address 127.11.225.126:33207)
0811 15:03:12.514402 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:12.514406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:12.514553 (+ 147us) server_negotiation.cc:407] Connection header received
0811 15:03:12.514762 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:12.514768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:12.514940 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:12.515082 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:12.515525 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.516319 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517275 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:12.517592 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:12.517715 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:12.518055 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:12.518723 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:12.519025 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:12.519336 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 15:03:12.519392 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":96,"threads_started":1}
I20260811 15:03:12.523110 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19396
I20260811 15:03:12.547091 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19517
I20260811 15:03:12.564471 12165 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasknb3eKX/build/debug/bin/kudu with pid 19645
2026-08-11T15:03:12Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3606 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7152 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (303137 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST